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CONGRUENCIES AMONG INTERPRETATIONS OF 
PSYCHOLOGICAL TEST AND ANAMNESTIC DATA’ 


KENNETH 


Stanford 


AND 


EDWIN S. SHNEIDMAN 


VA Neuropsychiatric 


NA CLINICAL SITUATION, when one uses — functions of both the instruments and of the 
I diagnostic tools such as interview tech- users 

niques or psychological tests the ultimate 
goal is usually to present a description of 


Che primary purpose ot the present study 


as lo investigate the congruencies among 


an individual in such a fashion as to facili personality descriptions made bv clinicians 
tate accurate predictions of the tested S's vhen such descr ptions are based on differ- 
future behavior. This description may be ent sources of information (instruments). 


limited to a single stacement (such as a In 


particular, the study was designed to in- 


diagnostic label) or may be in the form of 


vestigate congruencies (a) for several kinds 
an elaborate and detailed evaluation of the o¢ ¢e 
S's psychological status, including the rea tions, and psvchiatrically normal: 
genesis of his major personality character- fo, ' 


*hotics, neurotics psychosomatic 


several imstruments—the Rorschach 
technique, the Thematic Apperception Test, 
the Make A Picture Story test, the Minne 


for the development of new ones. In either sota Multiphasic Personality Inventory, and 


istics and some specific recommendations 


for the modification of those attributes or 


case, the procedure is characterized by the psychiatric anamnesis: and (c) for sev 
Intervention of an interpreter (the psve hia eral kinds of interpy fit tasks —true—false 
tris ‘cholog svchiatric social worker . 

irist, psychologist, psychiatric social worker factual items, true-talse inferential items. 


or whoever) between the behavior of the § 


Q-sort items, diagnostic labels, and ratings 


and the de scriptive statements. Although, 


as Meehl (1954) has indicated, it may be ; ; 
possible to avoid the interpreting middk Kations of the congruen 
cies’ ot the mstruments considere ‘re 
man, im current clinical practice this is nsidered here 


h e heen of won 4 <1 ( 
rarely done. Instead, the final product of a lave u tv najor kinds, In 


diagnostic interview or psychological test the first, every atte was made to mini 
examination consists of a series of. stat mize the influence of the Interpreter through 
ments based upon quasi-empirical norms, the use of objective scormg systems (even 
the personal ‘ Xperiences of the int rpretet though the lis ans occasionally crept in 
deductions from a hypothesized personality through the back door by means of rating 
structure, and just plain guesses. Cons« scales). These studies have the advantage 
quently the effective validity and the effe a! presenting precise quantitative results 


tive reliability of the diagnostic tools 


are unenable to. statistical manipulations, but 


Investigation was supported | \t tl ] with the definition 

rant trom the National Institute of Mental oncent reliabilitv’ and “validity” 

Health, Public Health Service. under the sponsor heen appropriate, but the authors have 

ship of the University of Southern California 2 P liscussion of these 
place scussion o 

Now Natior Tnstitut Heal the procedure and 
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they have been subject to the criticism that 
they distort the way in which the test in- 
struments are actually used in the clinical 
situation. The second type of study has 
treated the interpreter as a relevant part of 
the situation and has made comparisons of 
the similarities and the differences of molar 
descriptions based on different diagnostic 
techniques. These latter investigations are 
unable to measure with any assurance the 
degree of correspondence of one interpreta 
tion with another, based as they are on 
The 
study attempts to combine the advantages 
and to circumvent some of the shortcomings 


global matching procedures. present 


of both types of study mentioned above in 
an investigation of the effects of the psycho- 
logical test used, the clinician who interprets 
the test results, and the S who is tested.* 


SUBJECTS AND PROCEDURI 
lest Subjects 


Twelve test subjects (Test Ss) were used, all 
hospitalized at the time of testing. Three of the 
Ns were categorized as “normal” or nonpsychiatri: 
(Test S 1, 2, and 3), three as neurotic (Test S 
4,5, and 6), three as psychophysiological disorders 
(Test S 7, 8, and 9), and three as psychotic (Test 
Y 10, 11, and 12). Selection of the Ss was based 
upon an initial screening of records of consecutive 


new admissions into two Veterans Administration 


hospitals: a general medical hospital and a neuro 
psychiatric hospital. Formal requirements in the 
initial screening were that all Ss be Caucasian, 


male, Protestants, native-born veterans of World 
War II, with an education no less than the 10th 
or more than the 12th grade, and between 20 and 
35 years old. In addition, for the neurotics and 
psychotics it was required that they had not re 
ceived shock treatment, that the entrance diagnosis 
be unequivocally psychotic or neurotic, and that 
they be in sufficient contact for psychological test 
ing. For the nonpsychiatric (normal) Ss it wa 


' There is also a fourth possible source of vari 


ance: the different test administrators In ¢ 
present study, this aspect was held constant in tl 
all the tests administered to all the Ss were given 
by one test administrator Also, it can be mer 
tioned at this juncture that all the 


were obtained by one interviewer 


case histories 
This opportu 
nity is taken to extend our appreciation to Phillip 
\. Goodwin, and Sevmour Pollack, who adminis 


tered all the psychological tests and obtained all the 


case history data 


respectively, for this stud) 
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required that they have no record of any previous 
psychiatric disorder and that the hospital diagnosis 
be a straightforward medical one with no func- 
tional aspects. For the Ss in the psychophysio- 
logical category, in addition to the lack of recorded 
previous emotional disorder, it was required that 
the hospital diagnosis be that of a psychophysio- 
logical disorder generally considered to be of func- 
tional origin 

\fter the initial screening, the prospective Test 
’S were administered the Cornell Selectee Index, 
certain subtests from the Form I Wechsler- 
Bellevue Intelligence Scale (Digit Span, Block 
Design, and Similarities), and were interviewed 
by a clinical psychologist. All Ss with prorated 
[Q’s less than 90 or greater than 115 were elimi- 
nated. Prospective nonpsychiatric Ss who answered 
items on the Selectee Index which indicated pre- 
vious emotional disorders or who were, in the 
judgment of the psychologist, emotionally disturbed 
were also eliminated. All remaining Ss were then 
interviewed by a psychiatrist. In the case of the 
nonpsychiatric Ss, the psychiatrist’s judgment had 
to concur with that of the psychologist as to lack 
of any emotional disturbance before the S was re- 
tained; if not, the S was dropped. For the neu 
rotics, the decision was required that the disorder 
be definitely nonpsychotic and reasonably repre- 
sentative of one of the classical neurotic categories 
For the psychotics, the decision was required that 
the disorder be definitely nonneurotic and repre- 
sentative of a functional psychosis 


All Test Ss were administered the Rorschach 
(Ror), the Thematic Apperception Test (TAT), 
the Make A Picture Story test (MAPS), and the 
group form of the Minnesota Multiphasic Person- 
ality Inventory (MMPI). AIl the protocols (other 

in the MMPI) were recorded on tape and tran- 
scribed verbatim 


All the testing was done by one 
al psychologist, who had had seven years of 
clinical and testing experience 


In addition to the test materials, a comprehen- 


sive psychiatric case history was obtained from 
each of the 12 Ss. All the histories were obtained 
by one psychiatrist. Four to eight interviews of 
3 hr. duration were held with the Ss to obtain 
e case histories. These histories ranged from 
16 to 60 double-spaced typewritten pages and in 
luded such materials as presenting problem, devel- 
ypmental history, physical and laboratory findings 
es pti of the family life, etc.* 
The age, marital status, occupation, hospital 
gnosis, etc. for each of the twelve Test Ss are 
given in Table 1. An abbreviated case summary 
rea S presented in Appendix A 
imit ms Of space prevent the duplication of 
e full case histories here, but case historv for 


presented as 


\ Case History of 


Harris 


Paranoid Schizophrenia” in Burton and 


2 
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PSYCHOLOGICAL TEST 


AND 


ANAMNESTIC DATA 


rABLE 1 


SUBJECTS* 


Marital 
Extraction Status 


English- Div. Postal clerk, 


Swedish 


Irish Student at 


agriculture school 


Dutch 


English- Store salesman 


Dutch 


Scotch- 
Dutch 


Mechanic 


Swedish Store salesman 


English- 
Dutch composer 
English- 
Irish 


Carpenter 


French- Machinist 


English 


Dutch- 
English 


Student 


English Unskilled labor 


Danish 


Sgl. Unemployed 


* All Ss are male, Caucasian, Protestant, native born, 10th—12th grade educatir O 


lest Judges 


Forty-eight clinical psychologists served 
as test judges Cie) for the study. Twelve 
TJ’s were selected to interpret the Ror- 
schach (R1I—R12), 12 to interpret the TAT 
(T1-T12), 12 to interpret the MAPS test 
(M1-M12), and 12 to interpret the MMPI 
(11-112). Selection of the MMPT judges 
was from lists of clinical psychologists pro 
vided by Robert FE. Harris and Starke R. 
Hathaway; MAPS test judges were selected 
from a list provided by Edwin S. Shneid 
man; Rorschach and TAT judges were 
selected from lists drawn up by the authors 


Occupation 


salesman, policeman 


IBM repairman 


Waiter, aspiring 


Hospital Diagnosis 


Fractures, left elbow, left tibia, left fibula. 
No psyc hiatric disorder. 


Fractures, right elbow, right hip, right ankle, 
pneumothorax. No psychiatric disorder. 


Herniorrhaphy. No psychiatric disorder. 


Chronic anxiety with hysterical 


conversion neurosis and depression. 


reaction, 


Anxiety motor 
with symptomatic alcoholism 


reaction, a tension state, 


Mixed psychoneurosis with obsessive-com- 
pulsive trends, with phobic reactions 


Gastro-intestinal irritable colon syndrome. 


Psychophysiologic gastro-intestinal reaction 


with peptic ulcer syndrome 


Psychophysiologic skin reaction manifested 
by atopic dermatitis 


Schizophrenic reaction, paranoid type. 


Schizophreni 
ated type 


reaction, chronic, undifferenti- 


Schizophreni 
in type 


reaction, primarily catatonic 


and between the ages of 22 and 33 


the 
The 
therefore, a 
sample of skilled interpreters, rather than a 


the editors of 
Techniques. 


onstituted, 


with 
Pr live 
TI's 


in consultation 
Journal of 
forty-eight 


random sample of clinical psychologists in 
general. The names of the 48 TJ's are 
listed, in alphabetical order, in Appendix B. 
lnamnesis Judges 

l'wenty-three psychiatrists and one psy- 
chologist served as evaluators of the anam 
eleven practicing 
American 


materials were 
of the 


\ssociation, one 


psychoanalysts, members 


l’sychoanalytic was a 


s | oe | 
2) 
Sl 

7] 31 | 
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Diplomate in Clinical Psychology (Al- 
Al2), and 12 were, by their own evalua- 
tion, nonanalytically oriented members of 
the American Psychiatric Association ( P1 
P12). Selections were from lists prepared 
in consultation with the officers of the local 
associations. The 24 anamnestic judges 
(AJ) are listed, alphabetically, in Appen- 
dix B. 

In the selection of both TJ’s and AJ’s an 
initial number somewhat larger than the 
final group was contacted and asked to par- 
ticipate. The study was described briefly 
and it was indicated that an honorarium of 
fifty dollars would be paid for participation. 
The final 72 judges were selected at random 
from those accepting. 


Design and Procedure 


Each TJ evaluated the test protocols of four 
Test 
gories. The only information provided the judges 
in addition to the protocols was that the Ss 
Caucasian, male, veteran, 
school education, and between 22 and 33 years o 
age. The order in which any four protocols wer 
evaluated random one with the 
that each protocol be once the first one evaluated 
once the second, etc 


Ss, one from each of the four subject cate 


Protestant, wit! 


was a restriction 
Since there were 12 judges 
for each test type, four judges evaluated Ss T1, 4, 
7, 10 (Set 1), four evaluated Ss T2, 5, 8, 11 (Set 
11), and four T3, 6, 9, 12 (Set I1]). These 
sets were used for all test types 

Ten days after the conclusion of the evaluatior 
ot the four protocols, each TJ repeated the | 
of the first record of the four protocols 
seen, and, as another task, made an evalu: 
an hypothetical individual 
physiological reaction, a 


(a “normal,” a 
neurotic, or a psycl 
stereotype) corresponding to one of the f 
(The 
for another study and are 
in this monograph. ) 

The AJ’s evaluated two Ss on the basis 
anamnestic materials pertort 
stereotype evaluation but did not, however 


categories Stereotype ev iluatior 


not considered 


also 


They 
repeat analysis 


Interpretive Task 
In order that comparisons might be made 


1 


among the various T]’s and AJ's, the evalu 


®It may be appropriate to indicate 
that every effort was made to give no extran 
clues to the e.g., the authors—wl 
then in a VA neuropsychiatric hospital 
conducted their 
on university stationery 


judges ; 


corresponde 
ind 
mailing address 


ation of the Test S on the basis of the mate 
rials was structured in the form of 
tasks for the judges: 


five 


1. Answer the question, “How would you 
label this person diagnostically ?” 

2. Indicate on a line scale the degree of 
maladjustment of the S. 

3. Complete a Q sort of 76 items describ 
ing behavioral reactions to social stimuli 
and general adjustive patterns. 

+. Answer 117 true and false items repre 
senting the type of statements made in 
psychological test reports and also indicate 
the level of confidence in each answer. 

5. Answer 100 true and false items of a 
more or less factual nature about the S’s 
past and present life and also indicate the 
level of confidence in each answer. 


? 


Tasks 


sented in Appendix C 


Che items of 3, 4, and 5 are pre 


76 items of the O sort consisted of 
is dese ribing positive, negative, ol 


reactions to positive or negative 


timuli from either other persons or the en- 


vironment in general. The remaining 28 


were equally divided among. state 


satisfactory 


general adjustment 


and unsatisfactory adjustment 

17 psychological report type items 
vere selected from a population of 1706 
uch items, derived primarily by abstracting 


approximately SO test reports on patients in 


neuropsychiatric and general medical hos 
ital Inasmuch 
vere predominantly about 


personality characteristics, an equal 


s and mental hygiene clinics. 
items 


tatements 


was constructed, as 
contradictory of each of 
this 


sample of 


combined 
500 
lected and assigned, by one of 


into 


a random 


one of 18 psychological 


‘eport categories. These 18 categories 


‘ presented in Appendix D 


logical contradictories should be 


logical con 
statement “He hates his mother” 


For example, a 


rong feelings toward 


4 
The 
iter 
nents 
her 
the roup of s 
{ 
serting a log 
the original 
eroup of. it 
items was s 
pont 
neous 
wer ‘The two 
i tins mutually exclus 
tradictorv of the 
versity is the statement “He has no sty 3 
hi manthae 


PSYCHOLOGICAL TEST AND ANAMNESTI 


A recategorization of the 500 items by the 
other author resulted in disagreement on 
only 16 items, and these 16 were then 
eliminated. From the remaining 484 items 
the final sample of 117 was selected by pro- 
portional sampling among the categories, 
following the percentages of items in each 
category indicated in a previous study.* 

The 100 true-false, more or less factual 
items were a sample from an initial list of 
223 statements which could be asserted to 
be factually either true or false about each 
S on the basis of the anamnestic and hos- 
pital record data—e.g., “He was an only 
child”—and which were presumably rele- 
vant to personality description or develop- 
ment. 

RESULTS 

The results of this study will be discussed 
under the following six general headings: 
Diagnostic Statements, Degree of Malad- 
justment, Q Sorts, True-False Personality 
Items, True-False Factual Items, and Re- 
liability. In each of these the 
results will be described and the conclusions 
from, and implications of, these results will 
be discussed. 


sections 


Diagnostic Statements 


The first task of each TJ and each AJ 
was to indicate the diagnostic label he would 
assign to the Test S whose material he was 
evaluating. These diagnostic statements 
made by the judges are presented, verbatim, 
in Table 2. Although a complete statistical 


interpretation of this table cannot be given. 


“These 18 categories, and the proportion of 


items in each category, came from Sh: 
Walther, and Little (1951), in which the 
developed this category set based on 21 test reports 
which had analyzed into 1210 discrete 
f personality description. It should be 
his point that the present study (involving 12 
of four different categories) is a direct 
growth of this former study which involved 
one S, and thus raised many questions whicl 
be approached only by multiplying the types of 
and by having more than one S in each ti pe. Tw 
studies, one on the validity of MMPI interpreta- 
ions (Little & Shneidman, 1956) and one on the 
interpretations (Little & 
based on the i 


eidman, 
authors 
been items 


mentioned 


lidity of thematic 
an, 1955) 


several judges) 


have 


DATA 


some comments about its qualitative fea- 
tures can be made. The outstanding impres- 
sion (a disappointing one) is that diagnostic 
labels given by the T]’s from the psycho- 
logical tests were remarkably varied and in- 
accurate 
diagnosis and the authors’ cate gorization of 


the patient 


if one takes serioush psychiatric 


The second outstanding feature 
is that this inaccuracy is particularly notice- 
able in the case of the nonpsychiatrie Ss. 
These data have some interesting implica 
tions and lead to several speculations. One 
such speculation is that the training of clin 
ical people tends to emphasize the patho 
logical. (( nlv recently has there been any 
attention — to 


real and to 


strengths.””) It is an unhappy fact that very 


assets “ego 
few clinicians ever work with “normal” sub 
jects and that clinicians as a group have no 
population of normals to use as an internal 
infer 
ences. It is also relevant to indicate that in 
accuracy of 


ized reference from which to draw 


diagnostic labeling does not 


necessarily imply inaccuracy in describing 
psychodynamies, nality traits, ete. A 
psychological defense may have positive as 
well as negative value: a coping mechanism 
Is not necessarily a deformity. There is an 
important difference between stating, on the 
one hand, “An individual has obsessive fea 
tures” and, on the other hand. “An indi 
vidual is an obsessive neurotic.” The rs 
apparently made errors of confusing these 
two. 

] in Table 2 


give everyone interested in the use of psy 


data indicated 


Certainly t 


chological techniques some pause for 


thoughtful reflection. 


ndings presented in Table 2 


the Holtzman 


not espe- 
but the 


1 of the 


but 


5 
The th if 
question—as in the case and Sells 
(1954) study where projective techniques were not 
particularly successtul in making predictions of 
tiving success—that it may well be that the psvcho- 
logical tests were used either inappropriately or in e ; 
; t way in which clinicians ordinarily do not. use te 
tests. It is felt that to ask clinicians to make Bes 
diagnoses, ratings of adjustment, to do O sorts % 
and to complete T-F questionnaires are 
cially inappropriate tasks for clinicians, 
: present study does raise the entire iss i 
: role ot the “blind diagnoses.” This is cited. not to ie 
aluated { vant 
shed nderctandir f the pre saint 
ae 
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rABLI 
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Test Ss B 


48 24 AJ's 


Fest S 1 (Nonpsychiatric 


Judge 

1. Passive dependent personality 

2. Anxiety neurosis 

3. Hysterical personality; passive ag 
gressive 

$4. Schizophrenic with homosexual ten 
dencies 

1. Psychopath—immaturity reaction 

2. Schizophrenic; hebephrenic and 
paranoid features 

= \evressive reaction 


Simple schizophrenia or alcoholic 


Test 


MMPI 


\namnesis 


2 (Nonpsychiatric Continued 


1. Normal 


2. Hysterical character 


3. Without personality disorder 
4. Psychoneurosis, conversion hysteria 
reaction 


1. Within normal range—no_ psychi- 


itric disorder 


2. No psychiatric disease 


3. No psychiatric disorder present 


+. No psychiatric illness 


MAPS 


MMPI 


\namnesis 


ROR 


MAPS 


1. 


3 


Schizoid character 

Schizoid personality; organic brain 
damage? 

Schizophrenic, chron 

Psychopathic personality with some 
schizoid trends 


Character neurosis 

Chronic sub-optimum adjustment 
level 

Hysteria 

An extremely defensive normal 


No psve hotic disease or disorder 
Neurotic personality, mild 
Character disorder, mild 
Phallic-narcissistic character dis 
order 


Pest S 2 (Nonpsychiatric 


Schizoid character-—depressive 
trends 

Compulsive character 

Passive aggressive personality dis 
order 

Conversion reaction 


Psvchoneurosis, mixed, homosexu 
ality 

Anxiety neurosis 

Neurotic, obsessive-compulsive 

Character neurosis 


Passive aggressive (dependent 
personality 

Neurotic reactive depression 

Neurotic (hysteri 

Anxiety reaction with compulsive 
features 


ROR 


MAPS 


Fest S 3 (Nonpsychiatric 


1. Incipient schizophrenic 
Schizophrenic, probably paranoid 
type 
3. Paranoid schizophrenia 
+. Schizoid personality, paranoid and 
homosexual trends 


1. Schizophrenic 

2. Anxiety neurosis with hysterical 
features 

3. Character neurosis 

+. Passive-aggressive reaction. with 
schizophrenic episodes—-emo- 
tional instability 


Normal” with mild obsessive and 
compulsive trends 
Schizophrenic, mixed type, chronic, 
severe 
Schizophrenic reaction, catatonic 
features 

$. Character disorder with hysterical 
and homosexual trends 


1 Passive aggressive personality 
asocial psychopath 

2. Hysterical personality 

3. Simple adult maladjustment 

$+. Simple adult maladjustment, « 


tional instability 


1. Character neurosis, passive-aggeres 


sive tvpe 


2. Character within normal limits 
3. Normal 
Nort al 


2 
|) 
ROR 
PAT 
: i. 
4. 
1. 
? 
3. 
4. 
| 
3 
MMPI 
rAT 1. 
3 no- 
4 L 
1. 
2 
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TABLE 2 


Test S 4 (Neurotic 


ROR 1. Mixed neurosis with obsessive 
features 
2. Obsessive compulsive, possibly with 


schizoid trends 
3. Character disorder 
hysterical features 
4, Neurotic 


with anxiety 
obsessive compulsive, 


and depression 


anxiety con- 
spicuous 
TAT 1. Normal adult with character de- 
fenses of an obsessive-compulsive 
nature 
Zz. Character disorder, passive de- 
pendent features 
3. Passive aggressive reaction with 
hysterical features 
4. Psychotic features in a passive- 


feminine character 


MAPS 1. Immaturity reaction 

2. Obsessive compulsive homosexual 

3. Obsessive compulsive 

4. Hysteric phobic reaction with ob- 
sessive trends 


MMPI 1. Normal 
2. Essentially normal individual, mild 
obsessional reactions plus homo- 
eroticism problem 
3. Normal 
4. Mild obsessive with 
zation 


some somati- 


Anamnesis | 1. Dissociative reaction (hysterical 

2. Anxiety reaction with depersonali- 
zation episodes 

3. Psychoneurosis, severe, 
type 

4. Personality trait disturbance with 
neurotic reaction 


hysterical 


Test S 5 (Neurotic 


ROR 1. Paranoid schizophrenic in remission 

Mixed pre-genital character, pas- 
sive-aggressive personality, pas- 
sive-aggressive type 

3. Obsessive compulsive reaction 

4. Schizophrenic 


reaction, paranoid 


type 
TAT 1. Schizophrenia, paranoid trends 
2. Paranoid schizophrenia in remission 
or partial remission, with possible 
acting out aggressive psychopath 
character structure 
3. Schizophrenic reaction 


4. Obsessive neurotic with depression 


AND ANAMNESTIC DATA 


Continued 


Test 


MAPS 1. 


MMPI 


Anamnesis | 1. 


ROR 1. 


MAPS 


MMPI 1. 


w 


S 5 (Neurotic) —Continued 


Schizo-affective psychosis 
Latent (incipient 


reaction 


schizophrenic 


Paranoid schizophrenic 
Schizoid personality with alcohol- 


ism possibly psychotic episodes) 


Simulated or acute psychosis in a 


basically psychopathic 


person- 
ality 
Psychopathic personality 


Man 


type 


depre SSIVE 


reaction, manic 


Psychosis, manic with paranoid 


features 


Passive-aggressive personality, ag- 
gressive type 

Anxiety state, with alcoholism and 
paranoid trends 

Latent s hizophre nia 


(Anxiety reaction 


Test S 6 


Neuroti 


mode 


Anxiety State, 
Anxiety 


rately severe 

ind depression in a com- 
pulsive personality 

Anxiety state 


Neurotic 


lense 


hysterical? 
personality, hysterical de- 


mechanisms 


LD pressive or hizo-affective 
Obsessive-compulsive neurosis, 
paranoid trends 


Normal 


Passive-dependency reaction with 
reactive alcoholism—psycho- 
neurosis 

Anxiety reaction, mild, with ob- 


sessive compulsive features 
Hysterical character 
Could be a normal 
Normal adult with mild homosexual 
conflict 


\nxiety neurosis superimposed on 
i latent paranoid schizophrenia 

Mild neurotic depression 

Psychoneurosis, with de- 


somatic 


mixed 
anxiety, 
complaints 


press'on, and 


Anxiety neurosis 


| 
1 
2. 
4 
3. 
— 
3. 
_ 
TAT | 1. 
2. i 
4. 
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TABLE 2—Continued 


LITTLE anp EDWIN S. SHNEIDMAN 


Test S 6 (Neurotic)—Continued 


Anamnesis 


| 1. Psychoneurosis, obsessional, in a 
schizoid character 
| 


2. Severe obsessive compulsive neu- 
rosis with depressive trends 
3. Mild, chronic, progressive schizo- 
phrenia, simple type 
4. Mixed psychoneurosis, or schizo- 
phrenic reaction, acute, early 
type, undifferentiated 
Test S 7 (Psychophysiological) 
: | 
ROR 1. A somewhat shy and_ inhibited 
normal 
2. Obsessive compulsive character 
3. Oral character disorder with ego 
restriction 
| 4. Schizoid, inadequate personality 
TAT 1. Immaturity reaction 
2. Character disorder, passive-depend- 
ent, possibly alcoholic 
3. Adjusted normal 
4. Neurotic depression, anxiety state 
in a passive inhibited compulsive 
character 
MAPS 1. Obsessive-compulsive 
2. Paranoid schizophrenia 
3. Anxiety reaction, possibly latent 
schizophrenia 
4. Schizophrenic reaction, catatonic 
type 
MMPI 1. Psychoneurosis mixed—somatic 
complaints 
2. Psychoneurotic reaction in an im- 
mature and self-centered person 
3. Hypochondriasis 
4. Somatization reaction, probably 
stomach ulcer 
Anamnesis_ 1. Somatization reaction, character 
problem 
2. Anxiety reaction with gastro-intes- 
tinal somatization 
3. Passive-aggressive personality with 
somatization of anxiety 
4. Psychogenic gastro-intestinal con- 
version syndrome (nonpsychoti 
Test S 8 (Psychophysiological 
ROR 1. Immature character, inadequate 
2. Masochistic character 
3. Personality trait disturbance, pas- 


sive aggressive personality 
4. Anxiety reaction 


MAPS 


MMPI 


Anamnesis 


ROR 


1. 


wiv 


tw 


1. 


Schizophrenia mixed or catatonia. 
Possibly organic factors 

Anxiety reaction in an inadequate 
personality 

Passive dependency reaction 

Neurosis with marked overt anxi- 
ety: phobias? obsessiveness? pos- 
sible epileptic 


Chronic brain syndrome with psy- 
chosis 

Psychogenic gastro-intestinal reac- 
tion 

Borderline schizophrenia 

Anxiety reaction with 
complaints 


somatic 


Depressive reaction in a chronically 
anxious and tense person 

Depressive reaction 

Reactive or neurotic depression 

Anxiety neurosis 

Psychophysiologic gastro-intestinal 
reaction with peptic ulcer 

Psychophysiologic gastro-intesti- 
nal reaction with peptic ulcer 

Psychosomatic gastro-intestinal 
disturbance, ulcer 

Anxiety, gastro-intestinal reaction 


Test S 9 (Psychophysiological) 


Psychoneurosis, mixed type—has 
some compulsive and hysterical 
trends 

Mixed neurosis, hysterical-phobic 
and anxiety features predomi- 
nating 

Psychoneurosis, mixed, with anxi- 
ety and depression 

Anxiety hysteria 

Compulsive neurosis, or 
pathic 

Character neurosis 

Anxiety reaction, precariously 
maintained 

Character disorder with narcissistic 
and psychopathic features 


psycho- 


“Normal” but with some obsessive 
features 

Schizophrenia, mild, chronic, am- 
bulatory 

Essentially normal with some im- 
maturity that may be largely a 
function of age 

Obsessive character disorder, with 
much tension and anxiety 


8 
PT Test S 8 (Psychophysiological)—Continued 
TAT 
3. 
4. 
4. 
3. 
4. 
3. 
TAT | 
2. 
3. 
4. 
MAPS 
‘ 
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TABLE 2—Continued 


Test S 9 (Psychophysiological)—Continued Test S 11 (Psychotic) 
MMPI | 1. Passive-dependent personality ROR 1. Simple schizophrenic , ’ 
2. Hysterical personality 2. Schizophrenic reaction in partial 
3. Adult situational reaction remission, chronic 
4. Normal personality 3. Psychotic disorder, schizophrenic 


reaction 
4. Schizophrenic reaction, paranoid 
type 


Anamnesis 1. Passive dependent with somatiza- 
epe 
tion (skin) TAT 1 


Conversion hysteria 


2. Passive dependent character dis- 2. Schizophrenic in partial remission, 
order with severe inhibitions paranoid features 

3. Psychophysiologic skin reaction, 3. Immaturity reaction; impulse neu- 
passive dependent character rosis 

4. Passive aggressive personality 4. Schizophrenia 


MAPS 


1. Schizophrenic reaction 
T S$ 10 (Psychoti 2. Normal 
wade 3. Simple schizophrenic or schizo- 
phrenic character disorder 
ROR 1. Ambulatory schizophrenic 4. Schizophrenic chronic with para- 
2. Compulsive character noid trends 
breaking down MMPI : Psychosis in a s¢ hizoid personality 
4. Inadequate character 2. Schizo-affective 
3. Acute anxiety state 
4. Manic depressive psychosis with 
ef 
paranoid features 
TAT 1. Impulse neurotic, immaturity re- 


action Anamnesis | 1. Schizophrenic episodes in a poorly 
2. Character disorder, depressive fea- organized personality 

tures 2. Schizophrenic reaction, chronic, se- 
3. Immaturity reaction and behavior vere, undifferentiated 

disorder, ‘“‘punishment seeker” 3. Schizophrenic reaction, type un- 
4. Neurosis: some depressive features differentiated 

and probably considerable anxi- 4. Schizophrenic reaction, undiffer- 

ety 


entiated 


‘est S 12 (Psy« hotic) 


MAPS 1. Anxiety neurosis — _ 
) Je > 3S] 
= Neurotic depression : ROR 1. Passive aggressive character, pas- 
3. Character disorder, psychopathic sive dependent type 
personality ; 2. Neurasthenic with paranoid trends 
4. Depressive reaction 3. Organic or simple schizophrenic 
4. Schizophrenia, paranoid features 
MMPI 1. Paranoid schizophrenic PAT 1. Psychosis, probably schizophrenic 
2. Acute agitated psychotic or severely type 


disturbed neurotic 2. Anxiety neurosis ; 
3. Paranoid schizophrenic episode with 3. Highly schizoid but still obsessive 
acute anxiety personality ; 
4. Paranoid schizophrenic episode with +. Schizophreni process with decom- 
marked anxiety pensating obsessive compulsive 


defenses 


Schizoid personality 


Anamnesis 1. Schizophrenic reaction, paranoid 2. Schizoid character with moderate 
type depressive and obsessive features 
2. Schizophrenic, mixed type, para- 3. Schizoid personality 


noid defenses prominent 
3. Schizophrenic, paranoid 
Paranoid schizophrenia 


Passive dependent character dis- 
order with borderline psychotic 
trends 


9 
7 
yd 
MAPS | 1. 
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Test S 12 (Psychotic)—Continued 


MMPI . Reactive depression in a latent 
paranoid schizophrenic 
Passive dependent personality 
Psychoneurosis, obsessive compul- 
sive type with depressive features 
Paranoid schizophrenic, probably 
in partial remission 


Although a complete statistical evaluation 
of the material in Table 2 was not under- 
taken, an estimate of the consistencies of the 
diagnoses for any given Test S, where diag- 
noses were based upon the same protocol or 
anamnestic material, was obtained in the 
following fashion: 


1. Each diagnosis for each S based upon 
the same information source (i.e. the Ror- 
schach, the TAT, ete.) was paired with 
every other diagnosis based upon that same 
source of information, e.g., the diagnosis of 
Judge R1 for Test S 1 was paired with each 
of the other Rorschach judges’ diagnostic 
statements for Sl. Stix paired comparisons 
were thus obtained. A similar procedure 
was used for the TAT, MAPS, MMPI, and 
AJ's. For each S, then, 30 pairs of diag- 
nostic statements were available. 

2. As a chance probability baseline, 23 
sets of four diagnoses were selected at ran- 
dom from the 240 listed in Table 2. For 
each set, all possible pairings of the four 
diagnoses were made giving 138 chance 
combinations in all. 

3. The total of 498 pairs of diagnoses 
were typed and distributed to four compe- 
tent psychodiagnosticians with instructions 
to rate each pair on a six-point scale of 
similarity. The instructions to the raters 
and the defining points of the scale are 
given in Appendix E. Since six possible 
scores (0-5) were available for each pair 
of diagnoses, product moment correlations 
were computed among all raters. The aver 
age correlation among the four psycho- 
diagnosticians was .73 indicating a moderate 
degree of agreement among them. The 
chief source of disagreement appeared to 


TABLE 2—Continued 


Test S 12 (Psychotic) —Continued 


Anamnesis Catatonic schizophrenic 


Schizophrenic reaction, catatonic 
type 

Schizophrenic reaction, catatonic 
type 

Schizophrenic reaction, catatonic 
type 


be over the use of similarity of dynamics 
versus similarity of symptoms. 

+. or each pair of diagnoses, the sum 
of the four ratings assigned by the judges 
was used as the index of similarity of the 
pair. These ranged from 0 to 20 where 0 
indicated unanimous agreement on the part 
of the raters that the two diagnoses were 
utterly different and 20 indicated unanimous 
igreement that they were identical. The six 
figures thus obtained for the paired com- 
binations of diagnoses for any one S based 
upon a single information source were in 
turn summed to give an index of similarity 
for each Test-S, information-source cell. 


Table 3 gives the mean similarity indices 
(transformed back to a 0-5 scale) for TJ's 


PABLE 3 


DIaGNosis SIMILARITY INDICES AMONG Four 
JupGEs GrRovuPED ACCORDING TO INFORMATION 
SOURCE AND S Type 


MAPS MMPI 


hiatric 


10 
4. 
Ss Ror. TAT | EE Anam. 
1 1.5 1.7 34 2.4 2.7 
2 1.9 2.6 Ss 2.0 4.9 
3 2.9 1.2 3.2 
Neuroti 4 2.8 1.8 2.4 3.6 3.0 
5 2.0 2.7 2.6 aan 2.3 
6| 3.3 1.2 2.5 3.1 2.2 ; 
f Psychophysi- 7 2.0 1.8 2.7 3.3 
2 logical 8 2.4 1.4 1.4 3.8 4.5 
d rder 9 3.8 1.7 3.2 
Psychoti 10 2.3 4.6 
: 11 3.2 1.4 1.6 1.9 3.9 
12 1.8 3.4 2.0 5.0 
Mean 2.50 1.76 2.12 2.64 3.57 


and Test Ss. The fifth column presents the 
same figures for the AJ's. 

The first analysis of these data was a 
two-way analysis of variance of the first 
four columns of Table 3 with test types as 
columns and S$ category as the rows. None 
of the possible effects were significant, i.e., 
similarity of diagnosis did not differ as a 
function of either test type or S category. 

For the second analysis, simple ¢ tests of 
the differences between the means for the 
TJ’s and that for the AJ's were computed. 
The mean value for the AJ’s was signifi- 
cantly higher (beyond the .05 level) in 
every case. 

As a final analysis, each of the mean 
values for the four tests and for the AJ's 
were compared against the mean of the 
randomly selected sets of four diagnoses 
(N = 23). The mean of this distribution 
was 1.94 and the s was 1.34. The mean 
values for the Rorschach, MMPI, and the 
AJ’s exceeded this chance value beyond the 
.05 level; the TAT and MAPS did not. 

The results relative to agreement among 
diagnoses obtained from the above analyses 
may be summarized as follows: 


1. Agreement among diagnoses where the 
diagnoses are based upon either the Ror- 
schach, the MMPI, or anamnestic material, 
tend to be greater than chance. 

2. Agreement among diagnoses based 
upon the MAPS or the TAT do not exceed 
chance agreement. 

3. Agreement among 


based 


upon anamnestic material is significantly 


diagnoses 


greater than that based upon any other 
source of information. 
+. Agreement among diagnoses based 


upon any of the 
appe ar to be 
evaluated. 


sources considered do not 
affected by the tvpe of S 


As a testament to the efficacy of psycho 


diagnostic these leave 


something to be desired. Inspection of Table 


instruments, results 


2 has suggested that diagnostic labels based 
upon blind may be 
quite wide of the mark and the present 
analysis indicates the judges may not 


be even shooting at the same target. 


analy Ses of protoc Is 


that 
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How can one account for such disap- 


pointing results? Within the structure of 
the investigation there are certain factors 
that tend to influence the agreement index: 
extra weight was given to a single deviant 
diagnosis, agreement among the judges of 
similarity was by no means perfect, and the 
pool of diagnoses from which the chance 
index was derived was of restricted range. 
The first two tend to lower the 
similarity index and increase its standard 
error while the latter raises the mean chance 
similarity However, even under 
these conditions, the finding that AJ’s did 
significantly better than T]’s indicates that 
a higher degree of agreement is possible. 
Parenthetically, we might add that this 
higher degree of agreement of diagnoses 
based on anamnestic data as compared to 
test data is undoubtedly related to the deri- 
vation of our diagnostic labels themselves. 


factors 


index. 


They are based upon “the facts” of a man’s 
life, e.g., a schizophrenic is not defined as 
a person with pure C on the Rorschach or 
a high Sc score on the MMPI. but rather 
as a hallucinates, 


manifests autistic 


man who is delusional, 
the very 


a well-taken 


thinking, et 
facts” which are presented in 
anamnesis. 

The major implication of the 


sults is that the blind diagnosis of psvcho- 


present re- 
logical test protocols for clinical purposes is 
of dubious value. It is possible that com- 
better 


tests are used singly, 


binations of instruments mav pr 


igreement, but when 


agreement on diagnoses among test inter- 
T) 

Each TJ and each AJ was asked to rate 


ch S he evaluated on a maladjustment 
from 


scores, ranging 


iladjust- 


ent scale ich scores btained 

i Thes ores assem 

bled into sets cerresponding to the 
hree sets Sc 1,4, 7, 10: Ss 
1 Ss 3, 6, 9, 12, and investi- 
ited ins 1 three v analvsis of 

variance (Me) 1955, Model XVIT) 
In each anal I’s formed tl rows 


| | 
O th 
5 


TABLE 4 


ANALYSIS OF VARIANCE OF MALADJUSTMENT 
RATINGS FOR THREE Sets oF Test Ss 


Variance 

Source df Set I Set II Set III 
TJ's 12 3.0 2.4 4.6 
Tests 3 ve 6.5 1.7 
S type 3 14.4* 40.6* 17 .8* 
Test X S 9 &8.4* 5.3* 6.0* 
Remainder 36 2.6 1.8 2.0 
Total 63 


* Significant at .01 level. 


type of S the columns, and tests the blocks. 
Results of the analyses are given in Table 4. 
Table 5 gives the mean maladjustment rat- 
ings of four judges for each S$ based upon 
the several information sources including 
the anamnestic data. 

In each of the three analyses, differences 
among tests were not significant but differ- 
ences among S types were. In addition, the 
interaction between test type and S type was 
also significant in each analysis. Differences 
among S types were to be expected but not 
in exactly the form obtained. In S Set I, 
the psychotic was judged most sick, the non- 
psychiatric S and the psychophysiologic S 
next, and the neurotic as the least ill. In S 
Set II, the order was psychotic, neurotic, 


TABLE 5 


AVERAGE MALADJUSTMENT RATINGS FOR 
Eacu S sy TJ's AnD A}'s 


Ss Ror 


TAT | MAPS MMPI Anam 


Nonpsychiatric 1 ; 3. 
2 3.5 2.8 3.5 3.0 1.0 
3 6.0 5.0 [3 3.5 0 
Neurotic 4 i 3.8 4.2 2.0 ¢ 
5 4.0 6.0 75 6.8 0 
2 6.5 6.8 


Psychophysi- 7 4.0 3.0 6.2 5.0 3.5 
ological 3.0 6.8 5 4.5 
disorder 9 3.8 5 3.2 3.5 

Psychotic 10 5.0 4.8 5.0 8.0 0 

11 7.0 5.8 0 
5.8 
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psychophysiologic, and nonpsychiatric ; and 
in S Set III, psychotic, nonpsychiatric, 
neurotic, and psychophysiologic. These re- 
sults may be compared with those of the 
AJ’s who ranked the S types the same in all 
three sets. 

The observation that information-source, 
S-type interaction was significant in all three 
analyses indicates, of course, variation in 
the order of ranking depending upon infor- 
mation source, i.e. profile differences. lor 
example, in S Set I, the TAT judges 
considered the nonpsychiatric S most mal- 
adjusted, whereas the MAPS judges con- 
sidered the psychophysiologic S most mal- 
adjusted and the neurotic S as the least 
To test whether such patterns were stable 
a fourth analysis was made using the 
data in the first four columns of Table 5 
with S sets as rows, S type as columns, and 
tests as blocks. The results of this analysis 
are presented in Table 6. As would be ex- 
pected from the preceding analyses, differ- 
ences among S types were significant (in 
that the psychotics were consistently con- 
sidered most ill) and there were no signifi- 
cant differences in mean judgments among 
test types after the combination of the S$ 
The interaction, moreover, was also 
nonsignificant, indicating that the apparent 
test by S-type effects observed previously 
were a function of the particular four 
Test Ss used in each of the three sets. 

Finally, a two-way analysis of variance 
(McNemar, 1955, Case VIII) was made of 
the data in Table 5 for each of the four 
Test S types separately in order to compare 


ones, 


sets. 


TABLE 6 


ANALYSIS OF VARIANCE OF THE MEAN 
MALADJUSTMENT RATINGS OF EACH 
Test S sy Four TJ's 


Source Sum of Squares df Variance 


Sets 102.9 Pal 12.8 
Test type 22.0 3 awe 
SS tvpe 350.8 3 116.9* 
Test X S 62.7 9 7.0 
Remainder 577.1 24 24.0 
Total $335.5 47 


12 
— * Significant at .01 level 


PSYCHOLOGICAL TEST 


TABLE 7 


ANALYSES OF VARIANCE OF MEAN MALADJUSTMENT 


Variance 


Source df, Non- Psycho- 
psychi- Neu- physio- Psy- 
atric rotic logical | chotic 
Ss 2) 438.6* | 654.4 | 186.2 115.2 
Information 
source 4, 556.2** 321.7 145.1 162.6 
Interaction 8 63.8 248.9 125.4 92.1 


* Significant at .05 level. 
** Significant at .01 level. 


the average ratings of the AJ’s with that of 
the T]’s. Table 7 gives the results of these 
analyses. 

Only in the case of the nonpsychiatric S$ 
are the mean maladjustment ratings of the 
TJ’s significantly different from those of 
the A]J’s. Judges for all test types tended 
to rate the nonpsychiatric Ss as significantly 
more maladjusted than the A]’s. 

The results of ratings of maladjustment 
may be summarized as follows: 


1. Psychotics as a group are rated as 
most maladjusted on the basis of all of the 
tests used. 

2. No significant differences occur among 
over-all mean ratings of maladjustment for 
nonpsychiatric, psychophysiologic, or neu- 
rotic Ss. 

3. No individual test elicits a significantly 
greater or lesser maladjustment index than 
any other test. 

4. For nonpsychotic Ss, maladjustment 
ratings based on test protocols are signifi- 
cantly higher than those based on anam- 
nestic material. 

5. For other than nonpsychiatric Ss, mal 
adjustment ratings based upon test proto 
cols are not significantly different from those 
based on anamnestic material. 

As a first observation, it is apparent that 
the maladjustment rating data reflect the 
same situation observed in relation to diag 
noses. Nonpsychiatric Ss are tarred with 
the pathologic brush. One is reminded of 
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Ernest Jones’ response to the question as to 
the characteristics of a normal person—that 
he didn’t know ; he had never met one. 

The present data do point up a phenom- 
enon not tested in the analysis of the diag- 
noses; psychotics are distinguished from 
the other three classes of Ss. It seems 
probable, therefore, that although agree- 
ment among diagnoses is no greater for. 
psychotics than for any other Ss, the diag- 
noses used are of a more pathologic nature. 


Q-Sorts 


The first question asked in analyzing the 
Q-sort results was similar to that raised in 
connection with the diagnostic statements, 
i1.e., Do judges working with different test 
types differ in the amount of agreement 
among themselves about the test subjects? 
The form of analysis used was the pseudo 
three-way analysis of variance with S sets 
forming the rows, tests the columns, and § 
types the blocks. Entries in the cells were 
the average coefficients for the six correla- 
tions among the four judges interpreting 
any particular protocol. None of the pos- 
sible effects was significant, i.e., there were 
no differences among over-all average inter- 
correlations for the different tests nor for 
the different S types. The interaction effect 
was also nonsignificant. 

Table 8 gives the analysis of variance 
data and Table 9 the average intercorrela- 
tions among the QO sorts arranged by tests 
and by Test Ss. For comparison, over-all 
averages for tests, S types, and the average 
intercorrelations among the 
given. 


AJ's are also 


FABLE 8 


ANALYSIS OF VARIANCE DATA OF THE AVERAGE 
INTERCORRELATIONS AMONG TJs’ Q Sorts 


Source Sum of Squares df Variance 
S sets 11574.3 8 1446.8 
S types 1878.7 3 626.2 
Tests 3635... 3 «1211.4 
S type x Test 2986.1 9 331.8 
Remainder 17411.0 24 725.4 
Total 374853 47 


RATINGS OF Four Types or Ss By TJ's AND AJ's 
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TABLE 9 


AVERAGE Q-SorT CorRELATIONS AMONG Four TJ's Usinc DIFFERENT 
INFORMATION SOURCES FOR Eacu Test S 


Rorschach 
TAT 
MAPS 
MMPI 


Average 


Anamnesis 


The second question asked was whether 
the TJ’s working with a specific test agreed 
among themselves to a greater extent than 
between The following method of 
analysis was used to secure an answer to 
this question: For each Test S the six inter- 
correlations among the four TJ’s working 
with a specific test were added to the six 
intercorrelations among the four TJ’s work- 
ing with another and the average 
secured. This average was paired with the 
mean of the 16 correlations between the 
two sets of four judges and the difference 
obtained. 


tests. 


test 


For each pair of tests, 12 such 
differences available, one for each 
Test S. A simple ¢ test of the mean differ 
ence of these 12 correlated differences was 
then computed. 


were 


Table 10 gives the mean differences 0 

tained by the above method. In all 

there was slightly greater agreement within 
tests than between, but only in the case of 
the MMPT paired with each of the 
tests were the differences significant, i.e 
agreement between MMPT judges and the 
other T]’s was significantly lower than the 


other 


agreement among judges working within a 
test type. Among the projective technique 
judges, however, agreement within tests was 
not, on the average, significantly higher than 
across tests. 

The third question raised was the amount 
between the and the 


of course, the question of 


of agreement 


AJ's. This is, 


validity where psychiatric judgments are 
used as the criterion. To answer the ques- 
tion, the four correlations of each TJ with 
the four AJ’s were transformed into 2’s 
and averaged. The average correlations 
(after back transformation) are given in 
Table 11. Those significantly different from 
zero at the .01 level (oa, - = .058) are 
marked with an asterisk. Examining these 
values in conjunction with the average in- 
tercorrelation among the AJ’s themselves 
(Table 9), it is apparent that part of the 
low agreement can be accounted for on the 
disagreement among. criterion 
judges. The are, however, rather 

low in spite of this mitigating 


ot 


values 


lo test differences among tests in corre- 
lation with the AJ's, three pseudo three-way 


lance were made, one for 


TABLE 10 


MerAN DIFFERENCES IN AVERAGE 
INTERCORRELATIONS BETWEEN Two TEsTs 
COMBINED AND THEIR Cross CORRELATIONS 


FOR 12 Ss 


14 
4 
Ss 
Test 
| 1 2 3 4 5 6 7 8 9 10 11 12 
| s6 44 -13 | 09 36 -06 | 45 58 -12 |-03 64 61 31 
| 46 14 -02 | 17 24 -09 | St 41 16 230 19 67 27 
45 28 14 45 22 38 50 56 05 25 07 71 35 
| 28 44 23 | 59 52 39 | OF 49 21 70 39 
| 54 72 #54 | 23 60 859 12 42 72 40 «44 52 
analyses of vari 
Test Ror. TAT MAPS 
TAT 012 3 
MAPS .037 
MMPI 176* .187* 


PSYCHOLOGICAL TEST 


TABLE 11 


AVERAGE CORRELATION OF Four TJ's 
Wits Four AJ's on Q Sort 


Ss Ror. TAT MAPS, MMPI 
Non- —38*  —30* 24* 
psychiatric 2 25* —14 —17* 54* 
3 | —05 —07 —11 11 
Neurotic 4 13 17* 23% 18* 
41i* 34* 39* 54* 
6 22* 00 —O1 26* 
Psycho- 7 02 09 02 03 
physiologic 8 47* 38* 46* 41* 
disorder 9 08 05 11 09 
Psychotic 10 07 —07 21* 38* 
11 32* 24* 30* 32* 
12 20* 53* 53* 16* 


* Significant at .01 level. 


each S set. Table 12 gives the results of 
these analyses. In each, T]’s formed the 
rows, S types the columns, and test types 
the blocks. In all, differences among S 
types were significant, but in none were dif- 
ferences among tests significant. For Set I, 
the interaction between test and S type 
reached the 5% level of significance, but 
since the effect did not appear in the other 
two analyses it must be considered an arti- 
fact of the particular group of Ss in that 
set. 


Although differences among S types were 
significant in each S set, the specific type 


TABLE 12 


ANALYSES OF VARIANCE DaTA FOR MEAN Q-SorT 
CORRELATIONS OF TJ’s With Four AJ's 


Variance 


Source df set I Set II Set III 
Judges 12 1049.8 647.8 540.7 
Tests 3 1596.1 1711.0 47.5 
S type 2728.5** 1949.9* 4298.5 
Test X Stype 9 841.6% 657.5 47.3 
Remainder 36 453.6 1451.6 
Total 63 


* Significant at .05 level. 
** Significant at .01 level. 
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with the highest mean correlation with the 
A]’s was different from set to set. In order 
to determine over-all effects, a fourth 
analysis was made using test types as rows, 
S types as columns, and S sets as blocks. 
Entries in the cells were the average corre- 
lations of four TJ’s with four AJ's for one 
S. Table 13 gives the results of this analysis. 
As would be expected, the Test S X S set 
interaction was significant, i.e., in different 
S sets differing § types elicited the highest 
agreement with the AJ’s. Block effects were 
also significant indicating differences in the 
over-all agreement between T]’s and AJ’s 
for the different S sets. Highest agreement, 
for example, occurred between TJ's and 
A]’s for the Ss of Set II. Finally, over-all 
column effects were significant. Testing the 
differences among the means indicated that 
this effect was determined by the remark- 
ably low agreement between T]J’s and AJ’s 
on the nonpsychiatric Ss. Differences among 
means for the other three S types were not 
significant 

A fourth question of interest is the 
amount of stereotypy in the TJ's evaluation 
of the pré ttocols. Since each made a 
O sort for four different Test Ss, stereo- 
typy may be defined as the difference be- 
tween the average correlation among the 
judge’s QO sorts and some index of the 
“true” similarity among the four Ss. The 
difficulty, of course, lies in securing an in- 
dex of “true” similarity. For our analysis, 
we selected the mean of patterned samples 
of correlations between Test Ss within an $ 


TABLE 13 


ANALYSIS OF VARIANCE OF THE AVERAGE Q-SORT 
CORRELATIONS OF Four TJ's witH Four AJ's 


Source af Variance 
Tests 9 4472.6 
S sets 2 51551.3*9 
S type 3 23597 .1** 
S set X O type 6 6150.0* 
Remainder 27 2061.9 
Total 47 


gnificant at .05 | 


** Significant at .01 leve 


; 
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set but across judges within one test type. 
For example, on Set I, all possible corre- 
lations among the QO sorts of TJ’s R-1 for 
TS-1, R-2 for TS-4, R-3 for TS-7, and 
R-4 for TS-10 were computed. To these 
were added the intercorrelations among the 
QO sorts of R-1 for TS-4, R-2 for TS-7, 
R-3 for TS-10, and R-4 for TS-1; and R-1 
for TS-10, R-2 for TS-1, R-3 for TS-4, 
and R-4 for TS-7. The average of these 24 
correlations formed the baseline estimate of 
the “true” similarity among the four Test Ss 
for the Rorschach judges of Set I. Similar 
indices were computed for other T]’s and 
for other S sets. Since this baseline estimate 
might still include a specific bias due to test 
type, an initial two-way analysis of variance 
was made of the baseline average correla- 
tions using S sets as rows and tests as 
columns. There were no significant differ- 
ences among tests or among S sets. 

A generalized bias resulting from a tend- 
ency of all clinical psychologists to say 
similar things about different Ss may still 
exist in the baseline estimates. However, no 


TABLE 14 
AVERAGE CORRELATIONS AMONG Four Q Sorts 


FOR Four DiFFERENT Ss By Eacu TJ 


Mean baseline 


S Set Il 


Mean baseline 


~ 


S Set II 


ww 


> 


Mean baseline 


method of analysis eliminating this bias was 
available. 

Table 14 presents the average correlations 
among Q sorts for four Ss for each TJ 
arranged by S set and test type. In the fifth 
row for each set is given the average of the 
mean values for each of the four judges in 
a given S set-test cell and in the sixth row, 
in italicized figures, the mean inter-S inter- 
judge correlation used as a baseline. A two- 
way analysis of variance of the differences 
between the values in the fifth rows and 
sixth rows was made. Table 15 presents the 
results. Test type effects were not signifi- 
cant, 1.e., there was no greater tendency for 
one test to elicit stereotyped O sorts than 
any other. Subject set effects, however, 
were significant, suggesting that one group 
of S protocols (Set IIT) tended to elicit 
more stereotypic evaluations than the other 
two. Since TJ’s and Test Ss were assigned at 
random to the three sets, no immediate ex- 
planation for this phenomenon occurs to us. 

As a last point, a simple test of the devi- 
ation of the mean of the difference correla- 
tions from zero for all tests and S sets com- 


bined was significant, i.e., a statistically sig- 
nificant degree of stereotypy exists among 


the TJ's. The absolute magnitude, of 
course, is quite small although examination 
of Table 14 indicates that certain judges 
have quite high intercorrelations among 
their four O sorts. 

The results of the analyses of the QO sort 
data may be summarized as follows: 

1. Agreement among judges interpreting 
the same not significantly 
affected by the tests. 


protoc¢ 1 is 


TABLE 15 


ANALYSIS OF VARIANCE OF THE DIFFERENCES 
BETWEEN MEAN WITHIN-]UDGE Q-SortT 
CORRELATIONS AND MEAN ACROss-] UDGE 
Q-SortT CORRELATIONS FOR Four DIFFERENT Ss 


Source 
S sets 2598 .! 
Tests 362.. 


S set X Test type 88 .: 


Total 


Ror. TAT MAPS MMPI 
: S Set I —O4 —06 22 —07 
26 —05 36 03 
41 —10 18 07 
28 22 26 
000 255 005 
211 —036 228 
35 38 16 00 
36 10 08 —09 : 
21 02 24 06 i 
08 24 18 —02 
250 185 165 —(012 
005 181 —065 
| 15 28 56 
—10 48 38 
03 O04 26 
002 225 322 11 
041 000 135 145 
— — * Significant at .01 level! 
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2. Agreement among judges interpreting 
the same protocol is not significantly 


affected by the nosological category of the S. 

3. Among projective tests, the degree of 
agreement among judges interpreting the 
same protocol is not significantly higher than 
the agreement with judges interpreting a 
different projective technique protocol for 
the same S. 

4+. Agreement between interpretations of 
MMPI protocols and projective technique 
protocols for the same S is significantly 
lower than agreement among judges inter- 
preting the same protocol. 

5. The amount of agreement between test 
interpretations and judgments of psychia- 
trists is not significantly different for the 
four tests used in this study. 

6. The amount of agreement between test 
interpretations for nonpsychiatric Ss and 
psychiatric judgments is significantly lower 
than that for neurotics, psychophysiological 
disorders, and psychotics. 

7. Test interpreters tend to make their 
interpretations in a stereotyped manner in- 
dependent of the S. 

8. Nosological category of the Test S does 
not significantly affect the degree to which 
stereotyped interpretations of test protocols 
are made. 


The fact that the degree of agreement 
among the judges interpreting specific pro- 
jective technique protocols is no higher than 
their agreement with judges interpreting 
different projective test protocols for the 
same Ss probably implies a common psycho- 
dynamic approach to the interpretation of 
projective test protocols. This common ap- 
proach seems to pervade interpretation to 
such an extent that unique contributions of 
the tests may be masked. The fact that the 
interpretation of MMPI protocols tend to 
be more in agreement among themselves 
than with the interpretations of projective 
techniques may well be a function of the 
following characteristics of the MMPI: that 
the data presented in the MMPI protoc Is 
have a fairly high degree of specificity ; that 
there is less variability as to what MMPI 
(as compared with projective test) T]’s use 
for cues; that MMPI TJ’s have fewer cues 


than the projective test TJ’s; that conclu- 
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sions drawn from MMPI data are less in- 
ferential and more close to the phenom- 
enologically given (in that the MMPI is 
more similar to the anamnesis) ; and that, 
whereas the projective techniques obtain 
their intellectual permissiveness from psy- 
choanalytic theory, the MMPI, on the other 
hand, operates within an empirical tradition 
and deals largely with more denotable as- 
pects of behavior. Little wonder then that 
the “vision” of the clinicians who deal with 
questionnaire techniques (like the MMPI) 
is less blurred than that of the clinicians 
who must infer from projective techniques. 
However, it should be pointed out that the 
amount of agreement between test interpre- 
tations, on the one hand, and judgments 
from the anamneses, on the other hand, was 
not significantly different for any of the 
four tests used in this study. 

It should be stated that the findings and 
implications of the O sorts (and T-F items) 
should be clearly differentiated in the read- 
er’s mind from the findings and interpreta- 
tions of the diagnoses and degree of malad- 
justment. That is to say, the rather dis 
appointing findings that the tests do not do 
well in obtaining either inter-judge agree- 
ment or agreement between test judges and 
psychiatric judgments in terms of diagnostic 
labels does not necessarily mean that the 
tests do not retain a useful and important 
function in delineating psychodynamics and 
characteristics of personality as evidenced 
in Q-sort items and T-—F items. 


True—False 


Every TJ and AJ had (in addition to the 
diagnoses, estimates of maladjustment, and 
Q sorts), indicated whether he considered 


Personality Items 


each of 117 psychological report type items 
true or false for each S. The analysis of 
these data was limited to comparisons be- 
tween the judgments of the T]’s based upon 
test protocols and those of the AJ's based 
upon the anamnestic materials. 

The initial the analysis was to 
tabulate the judgments of the four AJ’s on 
the 117 items for each Test S and to select 
those items in which 3 of the 4, or 4 of 4 
AJ's agreed. Table 16 gives the number and 
percentage of the 117 items for each § on 


step in 


| 


TABLE 16 


THE SAME BY 3 OuT oF 4 oR 4 OvuT oF 4 
PSYCHIATRISTS 


1 

2 111 95 
3 04 80 
4 &5 
5 101 86 
6 99 85 
7 


10 105 00 
11 102 87 
12 99 


which 3 out of 4 or 4 out of 4 agreements 
occurred. A modal list was then constructed 
using the decision of the AJ’s for the 
selected items as the criterion judgment. 
(Items were not included when the AJ’s 
were evenly split on their truth or falsity.) 

Tetrachoric correlations were used as the 
index of agreement between each TJ] and 
the criterion. Four such indices were avail- 
able for each TJ, one for each S evaluated. 

As with the Q-sort material, three pseudo 
three-way analyses of variance were made 
of the present material, one for each S set. 
In each, TJ’s formed the rows, S types the 
columns, and Table 17 
gives the analysis of variance data for the 
three analyses of variance. 


tests the blocks. 


TABLE 17 
ANALYSIS OF VARIANCE DATA FOR THE TETRACHORIC 


CORRELATIONS OF TJ’s WiTH THE MODAL JUDGMENT 
OF THE AJ's ON ReEPorT Type ITEMs 


Variance 


Source df Set I Set Il Set III 
TJ's 12 1325.7 875.3 Ln 
Tests 3 718.2 1073.3 2025.7* 
S type 3 2567.0 10786.6** 16487.4** 
Test X S 

type 9 2894.7* 23875.8* 3118.4 
Remainder 36 1095.6 1022.3 1607.2 
Total 63 

* Significant at .05 level. 


** Significant at .01 level. 
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NUMBER AND PERCENTAGE OF 117 ITEMS MARKED 


TABLE 18 


AVERAGE TETRACHORIC CORRELATIONS OF 
Four TJ’s With THE MopaAL JUDGMENT OF 
Four AJ's oN Report Type ITEMs 


TAT 


Os Ror. 


MAPS | MMPI 


Non- 1 —20 O4 17 59 

psychiatric 2 —10 —20 12 47 

3 —31 —32 —19 38 

Neurotic 4 34 36 39 —02 


Psycho- 7 38 42 45 14 
physiologic Pe) 72 75 65 55 
disorder 9 58 8 44 22 


Psychotic 


11 65 37 32 80 
12 62 85 67 44 
The results varied from set to set. In 


Set I only the interaction approached sig- 
nificance, the main effects did not. In Sets 
Il and III there was a significant S-type 
effect, an interaction effect in Set II and a 
test effect in Set III. It is rather difficult to 
draw from such data, so the 
independent scores from the separate judges 
were averaged for a composite “validity” 
index. 


conclusions 


Table 18 gives these mean correla- 
tions with the criterion, of the four TJ’s 
working with each S-test combination. 

A fourth pseudo three-way analysis of 
variance was made of the data in Table 18 us- 
ing Test Ss as rows, tests as columns, and S 
types as blocks. The results of this analysis, 
presented in Table 19, indicate significant 
ditferences in agreement with the psychia- 
trists for different S types and a significant 
interaction the Tests X S type. 
The differences among S types is largely 


effect of 


accounted for by the extremely low amount 
of agreement between the T]’s impressions 
of the nonpsychiatric Ss and the psychia- 
trists’ impressions of these same individuals. 

Only one definite conclusion can be drawn 
from these data: T]’s have a significantly 
lower correlation with AJ's on nonpsychi- 
atric Ss than they do on the other three 
nosological categories. However, inspection 


18 
99 85 6 67 44 04 79 
9 105 00 
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TABLE 19 


ANALYSIS OF VARIANCE OF THE AVERAGE 
TETRACHORIC CORRELATIONS OF TJ's WiTH 
ANAMNESTIC MODAL JUDGMENT OF 


Source df Variance 
Test Ss 8 793.0 
S types 3 5956.5** 
Tests 3 512.9 
S X Test type 9 1070.7* 
Remainder 24 389.8 
Total 47 


* Significant at .05 level. 
** Significant at .01 level. 


of the average correlations in Table 18 in 
light of the significant interaction effect 
reported for Table 19 indicates varying de- 
grees of efficiency of the four tests for dif- 
ferent S categories. Specifically, the Ror- 
schach seemed about equally efficient for 
the three S categories of neurotic, psycho- 
physiological reaction, and psychotic, and 
markedly inefficient for the nonpsychiatric 
Ss; the TAT showed its optimum efficiency 
with the psychotic and psychophysiological 
Ss; the MAPS test indicated a pattern 
similar to that of the TAT, and the MMPI 
gave its best performance for the normal 
and psychotic Ss. 

It is interesting that in the O sorts there 
was a significantly higher degree of agree- 
ment between TJ’s and AJ’s for the psy- 
chotics than for any other nosological cate- 
gory, whereas with the True—False items 
there was a significantly lower degree of 
agreement of the TJ’s with the AJ's for the 
nonpsychiatric Ss. In other words, there 
were no differences in the amount of agree- 
ment between test results and anamnestic 
results as far as the O-sort data were con- 
cerned among the nonpsychiatric, neurotic, 
and psychophysiologic disorders, whereas 
for the True—False data there is no dis- 
crimination among the neurotic, psycho- 
physiologic disorder, and psychotic Test S 
data. It would almost appear that the True— 
False personality items function to dis- 
criminate between normal on the one hand 
and all other (“sick”) individuals on the 
In relation to the findings for 


other hand. 
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the specific psychological tests, one com- 
ment can be made about the MMPI: spe- 
cifically, that inasmuch as it apparently does 
differentiate the two extreme groups, its 
routine inclusion in a battery of tests is 
probably advisable, not so much to pick out 
the extremely aberrant individual, but more 
importantly to focus on the relatively well- 
adjusted (normal) S. Among the projec- 
tive techniques, the present data would sug- 
gest that the Rorschach would be first 
choice for an additional test in the armamen- 
tarium of the clinician—as indeed the sur- 
veys of use of tests in clinics demonstrate. 


True—False Factual Items 


A series of analyses similar to that de- 
scribed for the personality type True—False 
items was made for the 100 True—False 
factual items which the T]’s had marked as 
True or False for each S. Criterion keys 
were established by examining the case his- 
tories of each S for positive evidence of the 
truth or falsity of each statement. When no 
evidence either way was available the item 
was eliminated. As a result, the total num- 
ber of items considered varied somewhat 
from S to S, ranging from 89 to 100. 

Each TJ’s marks of true or false for the 
items from one S were matched against the 
key and the tetrachoric correlation between 
the two determined. Three pseudo three- 
way analyses of variance were made of the 
results, one for each S set. Table 20 pre- 
sents the results of these analyses. 


TABLE 20 


ANALYSIS OF VARIANCE DATA FOR TETRACHORIC 
CORRELATIONS OF TJ's WitH 
History Key For FAcTuAL Items 


Variances 


Source df Set I Set II Set III 
T]’s 12 546.3 265.1 469.1 
Tests 3 5815.8** 1255.7* 76.9 
S type 3089.5** 2781.7** 3387.8 
Test type X 

S type 9 942.0 1150.2** 705.4 
Remainder 36 521.4 2353.4 321.1 
lotal 63 

Sig t at .0 


ie 
: 
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In all, differences among S types were 
significant, although the type of S most ac- 
curately described varied from set to set. 
In Set I, the psychophysiological S was 
judged most correctly; in Set II, the neu- 
rotic; and in Set III, the psychotic. In all 
three sets the nonpsychiatric Ss were least 
correctly described. 

In two of the sets (I and II) differences 
among test types were significant with the 
MMPI being superior as compared to the 
projective tests. In Set III, this difference 
did not occur. Also in two sets (II and 
IIT) the interaction of test by S type was 
significant. 

A final analysis of the combined sets was 
also made. Table 21 gives the average cor- 
relations that constituted the data for the 
pseudo three-way analysis. As in the case 
of the report type True—False items, Test 
Ss formed the rows, tests the columns, and 
S types the blocks. Table 22 gives the 
results of this analysis. None of the pos- 
sible effects was significant, i.e. there was 
no difference among mean values for tests, 
S types, or interaction. The apparent supe- 
riority of the MMPI disappeared in the 
combined data 

It is apparent that the results of the 
analysis of the factual True—False items 


TABLE 21 


AVERAGE TETRACHORIC CORRELATIONS OF 
Four TJ's Wits Case History CRITERION 
FOR FACTUAL ITEMS 


TAT | MAPS’ MMPI 


Nonpsychiatric 


Neurotic 


Psychophysi- 
ologic 
disorder 


Psychotic 
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TABLE 22 


ANALYSIS OF VARIANCE OF AVERAGE CORRELATIONS 


Sum of 
Source Squares 


Test Ss 

S type 

Tests 

S type X Test type 
Remainder 

Total 


5596.0 
1709.5 
1788. 

2999 .2 
6919.3 
19012.0 


were inconclusive. One might question at 
this point whether psychological tests can, 
or ought, to correlate well with factual case 
history data. The whole issue of the post- 
dictive function of psychological tests is a 
debatable one. If one wants to know if an 
individual was an only child or came from 


a broken home, etc., a psychological test is 


not the optimal technique for ascertaining 
this type of information. 


Reliability 


The results reported in this section are 
comparisons of the interpretations made on 
the first protocol evaluated by the T]’s and 
interpretations made when the same proto- 
col was re-presented approximately 10 days 
later (cf. The data are in the 
form of coefficients of agreement between 


Procedure). 


first and second evaluations. 

Table 23 gives the two diagnoses of each 
PJ for the Test Ss classified by test and by 
ns type. These 48 pairs of diagnoses were 
presented to four competent psychodiag- 
nosticians who rated each pair on a 0-5 
scale with 5 representing maximum similar- 
ity. The average correlation among the four 
18 pairs was .83, indicating a 


raters for the 
good degree of agreement as to the similar- 
ity of the diagnostic pairs. The index of 
similarity for any specific pair of diagnoses 
was the mean of the ratings of the four 
judges. Table 24 gives the indices for each 
test type. A two-way analysis of variance 
of the data of Table 24 was made, using § 
rows and test type 


type as as columns. 


20 
OF Four TJ’s Case History CRITERION 
df Variance 
8 724. 
3 569. 
3 596. 
9 333. 
24-288. 
47 
No. of 
Ss Items | Ror PC 
96 —12 07 —22 42 4 
2 99 16 22 27 51 
02 20 10 
4 Os 12 12 09 53 
5 o8 42 —10 50 41 
6 97 16 34 37 13 
7 95 11 59 45 35 
; 98 Os 10 02 06 
i 9 99 15 —10 25 06 
10 96 14 21 O4 56 
11 O4 O4 06 13 
12 88 3? 290 29 2? 
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TABLE 23 


INITIAL AND REPEAT DIAGNOSES OF THE Same S BASED Upon 
THE PRESENTATION OF THE SAME TEST PROTOCOL 


MAPS MMPI 


Nonpsychiatric 


(a) Passive dependent (a) Psychopath— 
personality [initial immaturity 
diagnosis} reaction 


(a) Schizoid character (a) Character neurosis 


Inadequate per- (b) Schizophrenic, (b) Schizoid character b) Neurotic reaction, 
sonality, passive— probably catatonic; very defensive 
dependency re- psychopath 
action [repeat 
diagnosis} 
(a) Schizoid character (a) Psychoneurosis (a) Passive aggressive a) Normal 

depressive trends mixed—homo- (dependent 

sexuality personality 


Schizoid character Psychoneurosis, Passive—dependent (b) Essentially normal 
depressive trends mixed, or psycho personality basically a 
sis, schizophrenia, hvysteroid 


in remission personality 


Schizoid person- Passive-aggressive a) Character disorder a) Simple adult 
ality, paranoid and reaction with with hysterical and maladjustment, 
homosexual trends schizophrenic epi- homosexual trends emotional 


sodes —emotional 
instability 


instability 


) Schizoid person- Mixed psve ho- b) Passive de yx ndent I Emotional 
ality with decom- neurosis, severe, character neurosis instability 
pensating features with depressive, 
although some ego phobic, hysterical 
is intact and passive aggres- 


sive features 


Neurotic 


) Obsessive com- Character dis- (a) Obsessive com- (a) Essentially normal 
yulsive possibly order assive pulsive homosexual individual, mild 
with schizoid dependent features obsessional reactions 


features plus homo-eroticism 


problem 


Obsessive ) Character disorder b) Obsessive b 
compulsive hysterical and compulsive 


depressive features 


Anxious, uncertain 
individual with 
probably homo- 
erotic problems 
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TABLE 23—Continued 


Rorschach MAPS 


Neurotic—Continued 


(a) Mixed pre-genital (a) Paranoid schizo- (a) Latent (incipient) (a) Psychopathic 
character, passive- phrenia in remis- schizophrenic personality 
aggressive person- sion or partial reaction 
ality, passive- remission, with 
aggressive type possible acting out 

aggressive psycho- 
path character 
structure 


Anal character Depressive reaction | (b) Schizophrenia (b) Psychopathic 
with obsessive in obsessive incipient personality 
compulsive and personality 

masochistic trends | 


Anxiety and de- | (a) Obsessive-com- a) Hysterical (a) Mild neurotic 
pression in a pulsive neurosis, character depression 
compulsive paranoid trends 

personality 


Severe anxiety Hysterical char- (b) Hysterical (b) Hysterical person- 
neurosis in an acter, paranoid character ality with mild 
immature charac- trends neurotic depression 
ter. Intellectual 

and compulsive 

obsessive defenses 

too weak to protect 

him from anxiety 


Psychophysiologic Disorder 


Oral character Adjusted normal (a) Anxiety reaction, (a) Hypochondriasis 
disorder with ego possibly latent 
restriction schizophrenia 


Passive dependency Fairly well (b) Schizophrenia (b) Hypochondriasis 

reaction with adjusted normal (severe psycho- 

hysterical features neurosis with 
anxiety and hypo- 
chondriacal features 
predominating) 


Anxiety reaction Neurosis with Anxiety reaction (a) Anxiety neurosis 
marked overt with somatic 
anxiety: phobias? complaints 
obsessiveness? 


possible epileptic 


) Conversion ) Not psychotic. »)) Anxiety reaction (b) Anxiety neurosis 
reaction Severe neurosis with somatic 
or character dis- complaints; 
order with anti- immaturity 


social behavior personality 
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TABLE 23—Continued 


MAPS MMPI 


Continued 


Psychophysiologic Disorder 


(a) Psychoneurosis, (a) Anxiety reaction, (a) Essentially normal a) Adult situational 


None of the possible 
there 
among test types in 


1.€., 


mixed, with anxiety 
and depression 


Neurotic or 
schizoid person- 
ality 


Inadequate 
character 


Obsessive-com- 
pulsive neurotic 
with strong homo- 
sexual conflicts 


Psychotic disorder; 
schizophrenic 
reaction 


Psychotic disorder, 
probably a schizo- 
phrenic reaction 


Passive aggressive 
character, passive 
dependent type 


Passive-dependent 
character—possibly 
alcoholic 


were no 


effects was 
significant differences 
amount of agreement 


precariously 
maintained 


Character 
neurosis 


with some imma- 


reaction 


turity that may be 
largely a function 
ot age 


) Normal, if age is 
in lower range 


Psychoneurosis, 
anxiety reactiou, 
mild 


Psychotic 


Neurosis; some 
depressive features 
and probably con- 


siderable anxiety 


Passive-feminine 
character disorder 
with some depress- 
ive and some 
borderline schizo- 
phrenic trends 


Immaturity re- 
action; impulse 
neurosis 


Passive dependency 
reaction (imma- 
turity reaction) 


hosis 
probably schizo- 
phrenic type 


(b) Schizophrenia 


significant, 


between repeat diagnoses, nor among S 


types. 


Ratings of the degree of maladjustment 
of the S were made on second evaluation in 


the same fashion as on the first. 


Disagree 


Paranoid schizo- 
phrenia episode 
with marked 
anxiety 


Depressive reaction | (a) 


Phe 


with depression 


reaction Schizophrenia, 
paranoid type, 


acute 


Simple schizo- 
phrenia or schizo- 
phrenic character 
disorder 


Acute anxiety state 


Psychotic reaction: 
schizophrenia 


Anxiety hysteria 


Schizoid person- 
ality 


Reactive depression 
in a latent paranoid 
schizophrenic 


Schizoid person- 
ality with a strong 


Reactive depression 
(and/or conversion?) 
with latent paranoid 
hizophrenic 


suspicion of 
organicity 
reaction 


ment between first and second ratings for 
each judge is indicated in Table 25 in the 
form of discrepancy A negative 
number indicates that the judge changed his 
rating in the direction of increased malad- 
justment; a positive number indicates the 
converse, and a zero indicates no change. 


scores. 


he changes range from zero to one-half 


: 
s Rorschach TAT 
(a) 
| 
: 
11 
12 
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the scale length (8 units). An analysis of 
variance, however, indicated no significant 
differences among tests in absolute amount 
of change of ratings. 


TABLE 24 


MEAN SIMILARITY INDICES BETWEEN FIRST AND 
SECOND DIAGNOSES BASED UPON THE SAME 
TEST PROTOCOLS 


Ror. TAT | MAPS MMPI 


Non- 


psychiatric 


Neurotic 


Psyc ho- 
physiologic 
disorder 


Psychotic 


TABLE 25 


CHANGES IN MALADJUSTMENT RATINGS 
FROM FIRST TO SECOND OBSERVATION 
TAT | MAPS; MMPI 


Ror. 


Non- 


psychiatric 


Neurotic 


Psychophysio- 7 
logical 
disorder 


Psychotic 


Mean 


Table 26 gives the correlations between 
O sorts of first and second evaluations of 
the same protocol by each judge and the 

Table 27 gives the 
data for Table 26. 
Differences among test types are significant 


average for each test. 
analysis of variance 
in that the TAT judges have a significantly 
(P = .01) lower mean reliability coefficient 
than that for judges of the other tests. 
Table 28 gives the tetrachoric correlations 
between first and second evaluations of the 


TABLE 26 


Q-Sort RELIABILITY FIGURES 
(PrRopucT MOMENT CORRELATION 
FOR THE 48 TJ’s 


Ror. TAT | MAPS; MMPI 


Non- 94 


psychiatric 7 52 
19 


Neuroti 


Psvch »physio- 7 
logical 


TABLE 27 


\NALYSIS OF VARIANCE OF Q-SoRT 
RELIABILITY COEFFICIENTS 


Sum ot 


Source Squares Variance 


S type 640.5 
6064 . 
4272 
16177.: 
27154. 


Tests 
Tests X S type 
Within cells 


Total 


ant at .05 level 


‘ Ss 
1| 4.8 1.8 5.0 3.5 
2.5 5.0 4.5 
3 3.8 1.8 3.5 4.5 
4 ‘.2 3.5 +.0 $.5 
5 5.0 5.0 
6 3.35 1.8 5.0 3.8 — 
7 3.0 5.0 2.2 4.5 Ss ee 
S| 2.2 7.3 4.2 5.0 
62 
11 5.0 3.8 ay 1.0 51 ; 
12 4.5 5.0 3.5 
| CS 4 67 58 76 59 
E Mean 3.7 2.6 3.8 1.0 5 36 —O1 80 88 
6 26 —07 50 79 
70 78 47 58 
i 51 32 69 S4 
disorder 9 69 i4 66 
Psychotic 10 52 19 45 56 
11 08 24 54 12 
12 81 82 64 63 
— Mean .610 .354 .626 
1 0 0 0 
2 —2 —1 0 0 
3 —1 1 0 1 
| 4 1 —3 0 0 
6 1 0 
1 0 0 — |} 
2 1 0 0 
0 4 ) 3 213.5 
11 1 0 2 0 21.4 
12 —4 0 0 1 9 474.3 
1.00 1.17 83 58 47 
—— * Signific 


TABLE 28 


REpoRT-Type ITEM RELIABILITY COEFFICIENTS 
(TETRACHORIC CORRELATIONS) FOR THE 48 TJ's 


Ss Ror. 


TAT | MAPS; MMPI 


Non- 


psychiatric 


Neurotic 4 92 79 88 
5 


Psychophysio- 


7 71 96 79 94 
logical 8 74 58 94 90 
disorder 9 85 25 S4 90 


Psychotic 10 74 37 52 83 


117 True—False report-type items and Table 
29 the analysis of variance data. As in the 
Q-sort results, the average reliability figure 
for the TAT judges is significantly lower 


(P = .01) than that of the judges for the 
other three tests. 

Table 30 presents the tetrachoric correla- 
tions between the answers given to the 100 
True—False factual items in the first and 
second evaluations. The analysis of vari- 
ance data (Table 31) indicates that the 
situation is exactly the same as for Q sorts 
and report type items, i.e., that TAT judges 
have a significantly lower (P = .05) reli- 


ability figure than judges of other tests. 


TABLE 29 


ANALYSIS OF VARIANCE OF REPORT-TyYPE 
ITEM RELIABILITY COEFFICIENTS 


Sum of 


Source Squares df Variance 
Tests 2383.6 3 794.5 
S type 5648 .8 3 1882 .9* 
Tests X S type 2484.1 9 276.0 
Within cell 9766.7 32 305.2 
Total 20283 .2 


* Significant at .01 level. 
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TABLE 30 


Factual ITEM RELIABILITY COEFFICIENTS 
(TETRACHORIC CORRELATIONS) FOR THE 48 TJ's 


Os Ror. 


TAT | MAPS’ MMPI 


Non- 


psychiatric 


Neurotic 


Psychophysi- 7 68 93 46 &8 
ological 83 47 84 
disorder 9 69 41 89 88 


Psychotic 10 $9 


Mean 


These reliability data may be summarized 
as follows 


1. Diagnoses based upon repeat evalua- 
tions of the same protocol vary from iden- 
tical to markedly dissimilar 

2. Maladjustment ratings under the same 
conditions vary in a similar fashion with a 
mean change of 
12% and a range from 


absolute approximately 
zero to 50%. 

from 
mean of 


reliability 


to 94 


3. O-sort vary 
-.07 with an over-all 
about .55 for all T]’s combined. 


higures 


+. TAT judges make significantly less re- 
liable O sorts than judges of the Rorschach, 
MAPS, and MMPI. 


PABLE 31 


ANALYSIS OF VARIANCE OF FACTUAL ITEM 
RELIABILITY COEFFICIENTS 


Sum ot 
Source Squares df Variance 
Tests 333.1 3 110.4 
S type 2912.9 3 971.0* 
Tests X S type 2281.2 9 Z0a.0 
Within cell 8652.7 32 270.4 


Total 


* Significant at .05 level 


= 
: 
25 
Zz 1 72 67 80 91 7 1 70 86 88 83 5 
50 48 82 (47 56 38 89 
3 73 59 93 73 3 75 60 60 60 ‘ 
82 5 50 33 91 90 oe 
85 52 92 83 6 = 86 66 83 81 
12 93 80 68 87 12 63 Ss 82 
Mean .556 .770 846 743 590 .767 788 
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reli- 


item 
ability figures vary from zero to +.96 with 
an over-all mean for all TJ’s combined of 
about .73. 


5. Report type True—False 


6. TAT judges have a significantly lower 
mean personality type True—False item re- 
liability figure than do judges of the other 
tests. 

7. Factual True—False items reliability 
figures vary from .33 to .94 with an over-all 
mean for all TJ’s of about .72. 

8. TAT judges have significantly lower 
reliability figures for factual True-False 
items than do judges of the other three 
tests. 


The outstanding general finding from the 
reliability data is that the reliabilities of the 
interpretations made psychological 
tests vary considerably except for the indi- 
viduals interpreting TAT materials (who 
were conspicuously low in their reliabil- 
ities). This variation of reliability cuts 
across the test used and the type of S for 
whom the protocol was interpreted. The 
most general implication of these findings 
has to do with the notion of the validity of 
the psychological tests, inasmuch as there 
are inextricable relationships between valid- 
ity as defined and reliability of interpreta- 
tion. Thus it would appear that efforts to 
establish the “validity” of our current psy 
chological techniques—whether in terms of 
status validity, content validity, or congru- 
ent validity, etc.—are premature until ade- 
quate interpreter reliability has been estab- 
lished. 


DiscuSSsION 


Rather than recapitulate the results and 
the comments given in the preceding pages, 
the present section is limited to some final 
thoughts and opinions on the over-all impli 
cations of the study. 

One of the authors has reported a survey 
on the status of studies concerning the 
validities of projective techniques (Little, 
1957) which indicates that these studies, 
taken as a group, are contradictory or 
equivocal and in general do not give strong 
support to the contention that test proce- 
dures have clearly demonstrated validity 
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The general over-all results of the present 
study do not reverse this state of affairs. 
With a variety of types of Ss, with more 
than one S in each category, with experi- 
enced judges doing blind interpretations in 
response to the same questions, the results 
of the analyses for four frequently used 
psychological tests did not yield the kind of 
positive correlations that would gladden the 
hearts of psychological test proponents. 

The results are even somewhat more dis- 
tressing when one considers the magnitude 
of correlations obtained even when they 
were significant. A small decrease in chance 
variation is a legitimate goal for screening 
instruments but relatively useless for tools 
such as projective techniques where indi- 
vidual prognosis is desired. 

There are several legitimate objections to 
citing the results of the present study as 
indicating the level of clinical validity or 
reliability of the instruments used. ‘“Valid- 
ity’ is a complicated and ambiguous term 
at best and the use of psychiatric consensus 
as a criterion does not improve it notice- 
ably. The lack of agreement among the 
AJ’s was quite clear for a number of the 
Test Ss. Moreover, one may argue reason- 
ably enough that judgments such as required 
by the tasks in this study cannot be made 
from a single information source and that 
validity can be determined only on batteries 
of tests as actually used in clinical situa- 
tions. This assumption of a summative 
effect and/or an interactive effect of various 
instruments is a testable hypothesis, al- 
though it was not tested in the present 
study. An objection similar to this last one 
may be raised to citing the relatively low 
agreements among judges as evidence of 
unreliability of the instrument or the judge. 
\gain the effect of combined information 
sources on inter-judge agreement is testable, 
but was not within the scope of this study. 

In a certain sense, the study may have 
imposed on the TJ’s a “naive clinical” re- 
Holt’s (1958) schema. 
Blind analyses prevent the clinically desir- 
able 


quirement, to use 


progressive checking and modification 


iypotheses against other sources pre- 


sumed to be more valid. However. such 


| 


control was an essential element of the 
design of the study inasmuch as it was the 
individual instruments that were being 
assessed. 

Recognizing these restrictions on the 
simple application of the results to tests as 
used in clinical settings, the results still in- 
dicate room for considerable improvement 
in test interpretation. For the tests used, 
agreement on diagnoses will be only slightly 
better than chance, judgments of maladjust- 
ment will be skewed toward the patholog- 
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ical, agreement with psychiatrists as to per- 
sonality dynamics will be modest, and the 
clinician’s reliability in all these areas will 
leave much to be desired. Since there were 
marked differences in the correlations 
among the different judges, perhaps each 
individual clinical psychologist and psy- 
chiatrist should make it part of his busi- 
ness to ascertain his own personal validity 
and reliability coefficient with various cate- 
gories of patients, as measured against vari- 
ous criteria. 
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Test S 1 


Identification. Subject 1 is a 25-yr.-old, divorced, 
Caucasian male veteran of English-Swedish de- 
scent. He is a “fairly religious” Methodist, i.e., he 
observes major religious holidays but does not at- 
tend weekly services; he feels that he conforms 
and adheres to all Protestant religious principles. 
He has worked at various semiskilled jobs: postal 
clerk, spray painter, sheet metal worker, salesman, 
post office, police officer. He is residing with his 
mother and father in a rented apartment in a 
large city on the West Coast. He was seen in a 
VA general hospital. 

Description of patient’s appearance. Patient is a 
neat, well-dressed, quiet, cooperative, and friendly 
young man who appears his stated age. His left 
arm and left leg are in a cast. He is neither tense 
nor manifestly anxious, Patient is 5 ft. 10 in. tall 
and weighs approximately 150 Ibs. but looks smaller 
and lighter as he sits in his wheelchair, He presents 
the appearance of a “typical American boy” with 
clean-cut features. He speaks clearly without re- 
straint and with no apparent emotional difficulties. 

Presenting problem. The patient was involved 
in a motorcycle accident. He allegedly was not 
driving overly fast, but skidded on sand into the 
path of an oncoming automobile. He incurred a 
fractured left elbow and a fracture of the left 
tibia and fibula. He was treated for shock and 
received emergency fracture treatment and was 
then transferred to a large general hospital where 
he has received definitive treatment for his frac- 
tures. While in the hospital he presented no diffi- 
culties to the medical or nursing staff. 

Psychiatric diagnosis, In the opinion of the psy- 
chiatrist, there is no psychiatric disorder, There 
are some acting-out trends in the character forma- 
tion and a push for culturally accepted activities 
which could be presented by the patient to society 
as evidence of his strength and masculinity. How- 
ever, to the present time these have not been so 
excessive as to be considered pathological. The 
patient’s fear of inadequately playing the masculine 
role and his need to elevate his self-esteem and 
stature by constant activity and by mastering many 
things, plus the degree of restlessness he has 
evidenced in the occupational area, have not reached 
extremes which can be considered pathological 


Test § 2 
Identification. Subject 2 is a 23-yr.-old, single, 
Caucasian male veteran of Irish descent. He is a 
fairly religious Protestant who attends services 
about once monthly and on religious holidays. He 
is a student at agriculture school. He is residing 
with his parents, and previously lived in a dormi- 
tory at college. He was seen in a VA 


general 


KENNETH B. LITTLE ano EDWIN S. SHNEIDMAN 
APPENDIX A 


CASE HISTORY ABSTRACTS 


hospital. He had entered a smaller hospital previ- 
ously for treatment of multiple fractures following 
a motorcycle injury. 

Description of patient’s appearance. The patient 
is a pleasant, young adult sitting in a wheelchair 
with his right arm in a cast. His right ankle is 
slightly enlarged. The patient’s right hip is fixed 
with a pin. He is in no pain or distress and ap- 
pears happy and comfortable except for the limita- 
tions of the cast. Throughout all of the interviews 
the patient appeared cooperative and friendly. 
When erect he was approximately 5 ft. 8 in. tall, 
weighing approximately 140 lbs. He had a youth- 
ful, zestful expression and appeared no older than 
his chronological age. At no time did he show any 
obvious emotional conflicts or psychiatric difficul- 
ties. He had a crew hair cut. He had moderately 
strong features. He always spoke clearly without 
restraint and with no evidence of emotional ten- 
sion. He stated that he intended to return to school 
after he had recovered from his injuries. 

Presenting problem. The patient’s entrance into 
the hospital was occasioned by physical injuries 
and multiple fractures incurred in a motorcycle 
accident which occurred when an automobile sud- 
denly made a left turn without signaling. He was 
unconscious for a few minutes. An ambulance 
soon arrived which took the patient to the hospital. 
During the early days of hospitalization, he slept 
most of the time and had a groggy feeling during 
much of the time he was awake. He learned he 
had been operated on the day following the acci- 
dent and that his right elbow and right hip and 
ankle were fractured. At the hospital he had 
relatively little pain, although chest pain from 
pneumothorax lasted for 4-5 days after his entry. 
The patient is ambulatory with crutches, but he 
spends most of the time in a wheelchair. He ex- 
pects to leave the hospital in approximately 3 wks. 
He feels that he has relatively few problems about 
his physical condition and he is not concerned 
about the eventual outcome, having been informed 
that the bones were healing well 

Psychiatric diagnosis. In the opinion of the psy- 
chiatrist, there is no psychiatric disorder present. 
The personality trends shown by the patient, such 
as his acting-out tendencies, push into physical 
activity, push for culturally accepted activities, and 
the development of a “masculine approach” to 
adventurous and excitement-filled activities, have 
never appeared to an excessive or pathological 
degree. 


Test S$ 3 


Identification. Subject 3 is a 23-yr.-old, single, 
Caucasian male veteran of Dutch descent. He is 
Protestant; not an active church goer, but attends 
church for principal religious festivities and prays 


| 
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when in stressful situations. He is a highly skilled 
radar repairman. He is residing with his mother 
and sister in their home. He was seen in a VA 
general hospital for minor surgery. He had an 
uneventful surgical experience and expects to leave 
the hospital within 2 wks. to return to home and 
work. 

Description of patient’s appearance. The patient 
appeared as a well-developed, well-nourished male 
who looked no older than his chronological age 
with youthful appearance and manners. He was 
approximately 6 ft. tall, weighing approximately 
175 lbs. (His present weight is 167 Ibs., patient 
having lost approximately 7 Ibs. since his entry 
into the hospital.) Athletic habitus with no evi- 
dence of physical disproportion although patient's 
feet appeared somewhat small in comparison to his 
large bones and large physical frame. Patient had 
light blue eyes and reddish-blond hair, Facial fea- 
tures appeared regular and clean cut and patient 
gave a “typical American boy” appearance. He 
was very friendly, pleasant, and cooperative. He 
spoke clearly without showing physical evidence of 
emotional conflict and had no awareness of anxiety 
or emotional difficulties. He related well to the 
examiner. Ward behavior was reported as unre- 
markable on the nurses’ charts and patient was 
considered friendly and cooperative by hospital 
personnel. 

Presenting problem, Patient entered the hospital 
for a herniorrhaphy. Approximately 1 yr. ago, 
the patient noticed a small swelling in his right 
lower abdomen. He was checked by a physician 
in a nearby clinic and was told that he had a 
swollen gland in his groin. He had no further 
trouble with this until approximately 3 wks. ago 
when he noticed an increase in the swelling which 
now remained constant, whereas previously the 
swelling had fluctuated in appearance, disappearing 
for a few months and then reappearing. On this 
occasion, the patient noticed that the swelling was 
constant, was larger, and appeared lower down in 
the abdomen. He himself recognized this as a 
hernia and was able to reduce the swelling by pres- 
He visited his local physician who confirmed 
the patient's impression and recommended that the 
patient enter the hospital for this elective surgery. 
Patient has no other physical difficulties 

Psychiatric diagnosis. In the opinion of the 
psychiatrist, there is normal personality structure 
and the absence of any definite psychopathology 
in this case. There is evidence of ability to adapt 
to and adjust to life’s problems and experiences 
It is considered that the patient falls within the 
normal personality group without definite psy- 
chiatric disorder. 


sure 


Test S 4 


Identification. Subject 4 is a 27-yr.-old, married, 
Caucasian male veteran of English-Dutch descent 
He is a Protestant and very active in religious 
observances. He is a salesman by occupation. He 
is residing with his wife and children in their 


AND ANAMNESTIC DATA 20 


small home. He 
psychiatric hospital 

Description of patient’s appearance. Patient is a 
5 ft. 104-in. tall, 170-lb., pleasant-appearing male 
with wavy brown hair, blue eyes, and a freckled 
youshful face. He presents the appearance of a 
“typical American farm boy,” frank in demeanor 
and very direct and straightforward. As he speaks 
there is a suggestion of a stammer and he appears 
slightly ill at ease most of the time. Early in the 
interviews he spoke slowly and with a regular, 
even tone. Occasionally there is fine tremor of the 
hands. Toward the end of the interviews he ap- 
peared much more at ease but still continued to 
show slight signs of discomfiture. He is always 
pleasant, cooperative, and friendly, and relates very 
well to the examiner, Although during the inter- 
views he always appears calm and peaceful super- 
ficially, there is evidence of underlying tension and 
at times a suggestion of considerable hidden anger. 
The patient appears moderately neat, well dressed, 
and somewhat younger than his chronological age. 
His clothes give the appearance of a relatively 
recent weight gain, being generally tight and close- 
fitting. The patient perspires rather freely. He 
began to express his upset feelings and feelings of 
anger in particular as his relationship with the 
examiner improved. Except for his anxiety and 
tension the patient showed no other psychopatho- 
logical features during the interview. He was al- 
ways fully oriented and in contact with the ex- 
aminer and his environment. No frankly bizarre 
signs Or symptoms were ever in evidence, The 
patient appears of superior intelligence, shows no 
signs of intellectual deterioration and gives no 
evidence of psychopathological phenomena during 
the period of observation 

Presenting problem. The patient was transferred 
to the neuropsychiatric hospital from a large 
county hospital psychopathic ward after he had 
had a confused episode with amnesia. A vear be- 
fore, he acute anxiety with 
depression and short periods of “unconsciousness” 
and was hospitalized at the county hospital for 12 
hr. with a spontaneous ren that 


was seen at a VA _ neuro- 


had an episode of 


ission. at time. 


The patient has been receiving outpatient psycho- 
therapy at a mental hygiene clinic since that time. 


Immediately prior to his precipitating emotional 
disturbance the patient had been drinking consid- 
erably and also had been taking barbiturates. The 
episode of confusion and amnesia was self-limited, 
remitting in approximately one day and_ the 
patient was referred for hospitalization as a result 
of the impression of the psychiatrist conducting the 
outpatient psychotherapy. He felt the patient was 
not benefitting materially from his outpatient psy- 
chiatric care. In view of the patient’s poor progress 
on the outpatient level it was recommended that 
he enter the NP hospital. Although the wife filed 
commitment charges, the patient entered voluntarily 
for psychiatric treatment. The patient has shown 
signs of mild anxiety, increasing irritability, and 
at times mild confusion with reduced work per- 


formance, an > ha id previous episodes of 


~ 
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what were considered to be hysterical seizures since 
his discharge from the service at the age of 21, 
six years ago. 

Psychiatric diagnosis. In the opinion of the psy- 
chiatrist, this case presents the psychiatric features 
of a chronic anxiety reaction manifested by mild 
to moderate despondency and depression. In the 
acute anxiety state the patient developed an hyster- 
ical conversion psychoneurosis, manifested by acute 
confusion, dissociation, emotional lability, free ex- 
pression of his underlying aggressive feelings, and 
brief episodes of amnesia with loss of self-identity 
and self-misidentification. Also in the past there 
has been utilization of an “hysterical” technique 
of conversion paralysis. 


Test S 5 


Identification. Subject 5 is a 29-yr.-old, married, 
Caucasian male veteran of Scotch-Dutch descent. 
He is Protestant; attends Sunday services fairly 
regularly and prays nightly although he is some- 
what embarrassed about the adherence to nightly 
prayers. He has sentimental feelings about major 
religious holidays which he observes regularly. He 
does not feel himself to be rigid or orthodox in 
religious beliefs and principles. He is a mechanic 
and previously had various semiskilled jobs. He 
is residing with his wife and the wife’s child in a 
home purchased by the wife. Patient was threat- 
ened by his employer with forced resignation un- 
less he obtained treatment for his nervous state. 
He was pressured to take one year’s leave of 
absence for observation and psychiatric treatment 
He was seen at a VA neuropsychiatric hospital 

Description of patient’s appearance. Patient is 
a well-groomed, well-developed man, 6 ft. tall, and 
weighing 200 lbs. He has brown hair and brown 
eyes and a neatly trimmed mustache 
cooperative and friendly. 


He appears 
He has a husky, broad- 
shouldered appearance, appears his chronological 
age, and always is cheerful, friendly, and coopera 
tive, with a somewhat ingratiating manner. At all 
times he was well groomed and dressed carefully 
In all interviews he was quiet and showed no very 
intense emotional disturbance, but constantly 
showed presence of an underlying tension state 
This was manifested by tremulousness, mild per- 
spiration, and at times mild pressure of speech, 
mild embarrassment when discussing his recent 
history of emotional disturbances, and mild in- 
crease in motor activity as the interviews pro- 
At no time was there any bizarre behavior 
or abnormal thought content, and the patient 
showed no evidence of psychotic behavior or idea- 
tion. His affective state did not appear remarkable 
except for the underlying tension. The emotional 
lability which he described was not evidenced in 
the interviews 

Presenting problem. The patient served with the 
Army Air Force for two years. After a number 
of missions as a radioman he was returned to the 
United States where his anxiety reaction became 
manifest and disabling for the first time. After 


gressed 


he had volunteered for an additional tour of duty 
he was re-examined and discharged with a diag- 
nosis of psychoneurosis, anxiety state, and was 
given a pension for service-connected disability 
Since then there has been increasing “nervousness” 
manifested by high peaks of inattention, marked 
tremulousness of the hands to a degree where the 
patient is unable to work or feed himself, marked 
irritability, anger outbursts, emotional lability with 
occasional uncontrolled crying spells, fears of los- 
ing control of his feelings, and fears of appearing 
insane. He also had pressure headaches, insomnia, 
nightmares, increasing withdrawal 
and acquaintances, and concern 
over trivial, inconsequential matters. Marked irri- 
tability with family members, in particular his 
wife and children, also exists. He has occasional 
dizzy spells and “blackouts” usually associated with 
his drinking. During such “blackouts” the patient 
has acted aggressively and antisocially. The patient 
has had sufficient marital friction and dissatisfac- 
tion with his marriage to cause him to divorce two 
wives since his discharge 7 yr. ago, and he is now 
unhappily married to his third wife, 10 yr.. his 
senior. In the past 6 mo. the patient has com- 
plained of gastro-intestinal disorders 
with ion, heartburn, belching. There also 
has been increasing frequency of “blackouts” and 
dizziness which occur when he “looks down or 
moves about rapidly and changes from a sitting 
to a standing position rapidly.” At times he has 
noted that objects in front of him become indis- 
tinct and even completely disappear. Nail biting, 
insomnia, headaches, night sweats, and nightmares 
become more frequent and have interfered 
with his interpersonal, occupational, 
social, and marital adjustment. The patient is em- 
barrassed 


from friends 
and_ irritability 


increasing 


indigest 


have 


markedly 


and ashamed about his overt nervous- 
tremulousness which he is unable to 
control, and he shows marked irritability and bel- 
ligerency when attention is called to his physical 
tension state He has involved for the 
years with civilian authorities as a result 
of antisocial, dangerous behavior committed while 
under the influence of alcohol, but the patient 
denies that he is an alcoholic. He recognizes, 
however, that he drinks heavily when his tension 
high The patient traveled to the city 
is located alone and went on a 
mediately prior to admission, 
time he lost his wedding ring and 
his entry 


ness and 


become 
past tew 


into the neuropsychiatric 
hospital there has been a marked reduction in his 
anxiety reaction 


Psychiatr nos This case presents the 
psychiatr features of (a) an anxiety reaction, 
oderately seve manifested by marked irrita- 
bility ner tension state, insomnia, night sweats, 
lares, | laches, excessive perspiration, 
intestinal distress, occasional syncopy, and 


udequacy and inferiority; a 


motor tension state manifested jby moderate to 
syniptomatic alcohol- 
ism; (d) aggressive hostility, ari occasional anti- 


tremulousness; (c) 


social behavior—in an emotionally immature and 
unstable personality. In addition, the patient 
showed mild to moderate obsessive trends which 
are manifested as perfectionistic tendencies and a 
desire for orderliness and cleanliness and paranoid 
features seen as feelings of social isolation, mild 
ideas of reference, and feelings of discrimination. 


Test S 6 


Identification. Subject 6 is a 33-yr.-old, married, 
Caucasian male veteran of Swedish descent. He 
is a Protestant, not orthodox in religious attitudes 
or observances. He is floor manager in the sport- 
ing goods section in a large department store. He 
resides with his wife and 4-yr.-old child in a 
rented apartment and has been in a general hos- 
pital for 34 mo. prior to transfer to the present 
psychiatric hospital for further observation and 
treatment. He came into the VA neuropsychiatric 
hospital as a voluntary admission 

Description of patient’s appearance. The patient 
is a healthy appearing, well-developed, and well- 
nourished adult, 5 ft. 10 in. tall and approximately 
170 Ibs. in weight. He is clean shaven with regu- 
lar, strong features and a strong, rugged appear- 
He has a ruddy complexion wit! 
and brown eyes 


ance brown hair 
Hands and chest appear hairy. 
Although the patient was always pleasant and co- 
operative, there was most frequently an undertone 
of mild depression, at times mild anxiety, mani- 
fested by sighing and hyperventilation 
Typically the patient presented himself as a con- 
trolled, slightly tense individual with tension show- 
ing in his facial expression, bodil) 

There was an excessive 
shown in his speech and his 


some 


movements, 
gestures amount of 
movement 

was ponderous and controlled without ap- 
ig pedantic. He appeared of superior intel- 
nce and had more than average sophistication 
in psychiatry. His affective markedly 

ntrolled and always appropriate to the circum- 
tance \t 


State was 


s times when speaking about his rela- 
tions! with his wife and his recent psychiatric 
difficulties he became slightly tremulous and more 
tense. No frankly compulsive behavior was observed 
during the interview. Occasionally there was mild 
twitching of the facial musculature. Although the 
patient was always overtly friendly and coopera- 


examiner, at times he 


tive toward the 
t hostility 


expressed 
toward the hospital 
horities with expressions of resentment at the 
nent accorded him 


onism and 


The patient was always 


1S appointments and appeared sincerely 
sted in meeting 
tain help. The 


with the in order 
patient had no physical com- 


examiner 


hlem. Because the 
vious response to 


hospital was 


Presenting pr patient’s pre- 
psychotherapy at a 


poor, he was 


general 

transferred to a psy- 
chiatric hospital. His chief psychiatric complaints 
allegedly while he 
1944). 


kedly increased in the last few 


onset 


was in the 


ice eight vears prior (in They have 


vears until the 
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patient has become occupationally and socially dis- 
abled, estranged from his wife and family, and 
much more aware of his inner tension state. There 
have been progressively increased intermittent ex- 
acerbations and remissions. In the last year the 
symptoms have markedly increased in severity and 
frequency. The patient receives a veteran’s pension 
for his neuropsychiatric condition—head tremor, 
anxiety reaction. Also, in the last few years there 
has been a development of hand tremor with 
progressive difficulty in manipulating and control- 
ling his hand movements. A second complaint, 
numerous obsessive and compulsive trends which 
are not considered really disabling by the patient. 
These consist of an excessive need for cleanliness, 


fear of dirt, overconcern with human dirt and 
excreta, hand washing, compulsive needs to be 
certain that doors are locked, cigarettes in ash- 


travs put out, and obsessive counting of cracks in 
sidewalks, counting floors in buildings, and other 
compulsive and obsessive reactions 
phobic reactions of a mild consisting of 
fear of crowds, fear of losing control of himself 


Thirdly, he has 


aegree 


and of showing his emotion which he attempts to 
control by exaggerated speech mannerisms, etc. 
Fourth, the patient experiences a sub-acute anxiety 
state manifested by 
mild facial grimacing, and gripping of 
extremities 
drawal 


over tension and restlessness, 
hands and 


Fifth, there is an increasing with- 


from his friends and family with day- 
dreaming increasing in intensity and frequency. 
The patient shows msiderable eproat self- 
criticism, and loss of self-esteem with the subjec- 
tive experience of mild to moderate acute 
depression \ tension state a mpanies the de- 
pressed mood. The patient has a moderate degree 
of insomnia, mild loss of appetite without loss of 
weight since the onset of his psychiatric difficulties 


All of the patient’s symptoms allegedly increased 
markedly in the past vear prior to his entry into 
the hospital. Although there has been a decrease 
in the psychiatric s the patient’s inner feeling 
of upset and turmoil have ntinued unabated and 


the depressed mood has increased since his entry 
into the hospital 


In the opinion of the 
psvel this case presents the psychiatric fea- 
tures of a mixed psvchoneurosis in a_ schizoid 
character with obsessive-compulsive trends. The 
neurosis is manifested by anxiety symptoms, tremor 
of head and hands, and inner tension state, phobic 
reactions, obsessive-compulsive reactions, strong 
lepreciatory t Is witl lt feelings and a mild 
to moderate depression. There is also marked 
social withdrawal from group and immediate 

milv relationshit 


Subject 7 is a 3l-vr 


Id, married, 
English-Scotch-Dutch 
tant, religious in attitude, 
He is waiter, 
He is resid- 


but not orthodox in observance 


but aspires to be a musical con 


oy 
31 
early : 
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Caucasian male veterar 
descent. He is a Prot 
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ing with his wife in a rented apartment. He was 
seen at a VA general hospital. 

Description of patient’s appearance. Patient is 
a neat, well-dressed, young adult who appears no 
older than his chronological age. He is tense, and 
shows restrained appearance and mannerisms. He 
speaks with a low, modulated, restrained voice, 
without moving lips very much or opening mouth 
wide. No evidence of emotion during session 
except for patient’s gratitude at opportunity for 
talking with examiner. Patient was late for almost 
every session and openly very apologetic on this 
account. He was friendly and overtly cooperative 
and pleasant. 

Presenting problem. Chief complaint is presence 
of generalized sharp, diffuse, colicky abdominal 
pains with alternating diarrhea and constipation 
since military service in 1944. He was diagnosed 
as “irritable colon syndrome.” Physical examina- 
tion, laboratory tests and X rays all negative for 
organic pathology. Since 1944, patient aware of 
“nervousness” (anxiety and tension). Exacerba- 
tion and intensification of complaints in past year 
(1951). 

Psychiatric diagnosis. In the opinion of the psy- 
chiatrist, this case presents the psychiatric features 
of an anxiety reaction chronic, mild to moderate, 
with somatization reactions of a gastro-intestinal 
“irritable colon syndrome,” accompanying the anxi- 
ety reaction and tension state. 


Test S 8 


Identification. Subject 8 is a 29-yr.-old, single 
Caucasian male veteran of English-Irish descent 
He is Protestant. He is a carpenter and is resid- 
ing with his parents in their home. He was seen 
at a VA general hospital 

Description of patient’s appearance. The patient 
is a neatly dressed, well-developed and well- 
nourished, mildly obese, young white adult who 
appears a few years younger than his chronological 
age. He is 5 ft. 11 in. tall and weighs approxi- 
mately 200 Ibs. He has a general florid and ruddy 
appearance which allegedly resembles that of his 
father. In facial appearance, however, he says he 
resembles his mother. During the first interviews 
the patient was slightly tense but soon appeared 
to feel at ease with the examiner. In his speech 
and behavior during the initial interview he ap 
peared shy, restrained, and inhibited and this re- 
straint continued to some degree throughout all of 
the interviews in the discussion of his personal life 
He appeared fearful of offending the examiner but 
with increasing contact became much more friendly 
and demonstrative, always holding back somewhat 
as if “on guard.” He always appeared early for 
his interviews and appeared most eager to recount 
his personal history with the examiner. During 
most of the time he was interviewed he was await- 
ing transfer to the surgical service for peptic 
ulcer surgery 

Presenting problem. This is the patient's first 
admission to this hospital for treatment of a bleed- 


ing peptic ulcer. Abdominal complaints have been 
present since 1956 at which time a diagnosis of 
pyloric spasm without ulcer was made on X ray 
The patient has a history of two previous episodes 
of gastro-intestinal bleeding in 1947 and 1948 and 
has had one admission to another general hospital 
in 1949 with a diagnosis of a perforated ulcer 
Prior medical and conservative dietary therapy 
have produced transient relief. On this admission 
the patient entered the hospital when he recognized 
from his black, tarry stools and his increasing feel- 
ings of weakness that he was again experiencing 
gastro-intestinal hemorrhage. Although the 
patient has associated his previous bouts with emo 
tional disturbances, he offers no knowledge of any 
external precipitating factors of emotional disturb- 
ance which can be related to the present physical 
upset 

Psychiatric diagnosis. In the opinion of the 
psychiatrist this case presents the psychiatric fea 
tures of a mild anxiety reaction, chronic, with a 
mild degree of depression. The primary psychiatric 
diagnosis would be a psychophysiologic gastro 
intestinal reaction with peptic ulcer syndrome and 
sequelae. 


Test S 9 


Identification. Subject 9 is a 26-yr.old, single, 
Caucasian male veteran of French and English de- 
scent. He is a nondenominational Protestant and 
is not actively religious. He works as a machinist 
in the aircraft industry. He resides with his 
mother in the mother’s home. He was seen at a 
VA general hospital. 

Description of patient's appearance. The patient 
is a tall, moderately well-developed, nourished man 
with asthenic habitus, appearing thinner than his 
actual weight of 155 Ibs. He is also somewhat 
ungainly. He looks a few years older than his 
chronological age. He is dark complexioned with 
dark hair, is neatly dressed and appears pleasant, 
friendly, and cooperative. During all of the inter- 
views he appeared superficially relaxed but was 
evasive in discussing his family and personal his- 
tory. Although at first it was believed that he was 
deliberately and consciously evasive, the examiner's 
impression terminally was that the patient was 
markedly naive and ignorant about himself, his 
feelings, and feeling-experiences. He presented a 
picture of naiveté and ignorance of his personal 
experience which was accompanied by a marked 
passivity, a blandness and lack of concern over 
any problems at home or with his fiancée. The 
patient’s lack of introspection and lack of sub- 
jectivity was so marked that he could tell the 
examiner very little about himself because he 
remembered so little. He appeared to have re- 
pressed more than suppressed much of his personal 
history. When he was led to discuss more mean- 
ingful material he became more restrained and 
even more evasive, although he was unable to 
recognize his evasions. When displaying his feel- 
ings he showed facial mannerisms and exaggerated 
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surprise, amazement, and approval. On two occa- 
sions, when material about sexual relations, mas- 
turbation, and his feelings about his mother were 
brought up, the patient showed some objective 
anxiety and a flare-up of awareness of uneasiness 
and inner tension. At these times he immediately 
avoided further discussion of the material which 
appeared to disturb him. He showed a complete 
inability to express directly any hostility, dislike, 
or even unfavorable criticism. Pleasant and casual 
situations were stressed by him and he apologized 
for his inability to “like” everybody. 

Presenting problem. The patient entered the 
hospital with a diagnosis of atopic dermatitis. He 
was well until early 1952 when he developed an 
intermittent pruritus (itching) on the back of his 
neck and the extensor surfaces of both hands. Ap- 
proximately 1 mo. later a gradually spreading rash 
developed which has at times involved the larger 
portions of his face, his upper extremities, espe- 
cially on the flexor surfaces, and parts of his 
trunk, thighs, and lower extremities. The patient 
has been treated by a private physician and has 
responded temporarily to cortisone. However, when 
he was taken off cortisone the dermatitis had an 
exacerbation. For 5 mo. there were remissions and 
exacerbations that followed no consistent pattern 
according to the patient. Although he was again 
placed on cortisone he did not respond as previ- 
iously and thus sought hospitalization. The patient 
previously also had X-ray treatments and various 
topical aids to which he did not respond. In the 
hospital the patient showed moderate improvement 
with conservative therapy but showed a marked 
exacerbation of his dermatitis each time he left the 
hospital to go home to visit his mother and 
fiancée over the week end. Because of this specific 
temporal relationship, the dermatologist referred 
the patient for psychosomatic evaluation 

Psychiatric diagnosis. In the opinion of the psy- 
chiatrist, this case is diagnosed as a_ psycho- 
physiologic skin reaction manifested by atopic 
dermatitis, present in a passive-dependent character 
with marked fear of, and inhibition in, expressing 
his anger and sexual desires. 


Tesr S 10 


Identification. Subject 10 is a 22-yr.-old, single, 
Caucasian male veteran of Dutch-Scotch-English 
descent. He is Protestant and religious in attitude 
and observances. He is a student. He resides with 
his mother and stepfather at home. He was self- 
referred into the VA _ neuropsychiatric hospital, 
where he was seen. 

Description of patient’s appearance. The patient 
is a well-developed and well-nourished, young male 
who appears somewhat older than his stated age 
He has brownish-red, blonde hair, a ruddy com- 
plexion, and blue eyes. He is about 5 ft. 6 in. 
tall and weighs approximately 150 Ibs., with the 
general appearance of a stocky, athletic build. He 
is left handed, has small features and small hands 
He appears friendly; cooperative, and pleasant to- 
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ward examiner, but he is extremely anxious and 
tense and at times mildly agitated. He has a mod- 
erately fine tremor of the hands. His face flushes 
easily and he perspires readily, especially about the 
hands and forehead. At times during the inter- 
view he broke down tearfully. He spoke in a very 
low monotone. His conversation was connected and 
coherent except on a few occasions when there 
was marked pressure and tension. At such times 
there was mild disconnection. He showed no overt 
hostility. Often he appeared depressed and at 
times definitely suspicious. At no time during the 
interviews or during the period of observation on 
the ward did he active hallucinations. He 
appeared fully oriented and showed no obvious 
memory defects. Toward the end of his hospital 
stay the patient noted that he was concerned about 
some of the other patients who had recently been 
admitted because he felt they were looking at him 
and spying upon him. He connected his ideas of 
reference and mental turmoil with various emo 
tionally disturbing experiences he had experienced, 
and also to disturbing relationships with his rela- 
tives, his mother in particular. There was partial 
awareness of the seriousness of his mental cond 

tion and a desire for treatment 
inner upset was markedly 

increasingly more disturbed 
approximately 1 wk. before admission to the hos- 
pital by a physician who recommended that lhe 
enter the neuropsychiatric hospital as a voluntary 
patient. Although the patient was interested and 
eager for this treatment, both his mother and step 
father were strongly against his hospitalization and 
also against his somatic treatment 
which was subsequently recommended by the hos- 
pital staff 

Presenting problem. Although the patient's pre 

military service adjustment showed no frankly 
bizarre features, he appeared to be somewhat with- 
drawn at that time and a rather schizoid 
adjustment. At the age of 20, prior to his entry 
into service, he had already given evidence of mild 


show 


This awareness of 
reduced as he became 


The patient was seen 


receiving the 


showed 


confusion, irritability, restlessness, and inability to 
plan for the future. He enlisted in 1950 and for 
the first 6 mo. appeared to make a satisfactory ad- 
justment. From the beginning of his overseas duty 
in 1951 he began to show evidence of increasing 
confusion and had bizarre personal experiences 


He felt 


that he was subjected to excessive stress 


and undue responsibility in his military duty 
Feelings of unreality developed. He was struck 
by the “awesome” beauty of the scenery and felt 


that he had been there previously, had seen the 
surroundings and also the inhabitants. He 
became frightened by these feelings and by a pre 
monition of events which, according to the patient, 
actually 1 subsequently. He felt 


occurred 
that he had influenced 
ences 


native 


somehow 
events and experi- 
Following a homosexual experience in 1951 
and the NP hospitalization of his friend, 
whom the patient had recognized was frankly psy- 
chotic (he had had hallucinations and bizarre and 
frightening ideas), the patient 


these 


best 


became more con- 


: 
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fused and frightened. He developed marked head- 
aches, ringing in the ears, depression, fears of 
suicide, increased feelings of anger and resentment 
at the position which he held in the military, diffi- 
culties in thinking and concentrating, and a marked 
increase in nervousness and irritability. He was 
troubled with many conflicting ideas and was in a 
constant turmoil because of the inability to commit 
himself to any definite action. He became rumina- 
tive about his actions to the point of being unable 
to act. He began to think people were calling him 
names and looking at him, especially in crowds 
He developed insomnia and lost weight. He entered 
a military hospital for a period of 1 mo, and then 
returned to active duty. In early 1952 he returned 
to the hospital with an exacerbation of his symp- 
toms. He became suspicious of those about him, 
very anxious and tense, now doubting his sanity, 
and much more depressed. He was given a medical 
discharge from military service later in 1952. The 
patient moved west to live with his mother and 
became increasingly more upset as a result of her 
difficulties with the stepfather. The anxiety in- 
creased, he developed extreme awareness of his 
heartbeat, palpitations, and chest pains. He felt 
light headed and felt as if he were constantly 
febrile. The headaches became more severe and 
the patient sought treatment, upon which he was 
referred to the psychiatric hospital. 

Psychiatric diagnosis. In the opinion of the psy- 
chiatrist, this case presents the psychiatric features 
of a schizophrenic reaction, paranoid type, follow- 
ing the early acute undifferentiated type of schizo- 
phrenic reaction. The patient first showed confu 
sion of thinking and emotional turmoil with per- 
plexity, ideas of reference with weird and peculiar 
with feelings of awe and _ premonitions. 
Auditory hallucinations at first were mild and un 
clear and never developed into very clear-cut 
hallucinatory phenomena even in the more fully de 
veloped paranoid state. The outstanding psychiatric 
condition early developed was the perplexity and 
turmoil with increased ambivalent feel 
ings and confusion of thinking. Subsequently the 
thinking became much more unrealistic and autistic 
with 


ideas 


emotional 


a more definite development of delusions of 
persecution and ideas of reference. The behavior 
became more impulsive and unpredictable and the 
underlying anger, resentment, and aggressive feel 
were Also there developed the 
headache and 
particular the chest 
ferred to in the heart area 
state continued 


ings obvious 


somatic 
physical 


symptoms of scattered 
pains, in pains re 


and tension 


An anxiety 
i throughout the 


strot months of 


development of the schizophrenic reaction. The loss 
vy and the development of the 


with realit 
symptomatology are. the 


of contact 


bazarre most clear-cut 


symptoms 


a 29-yr-old, single, 
He is 
a Protestant and very religious in attitude and ob- 


Identification. Subject 11 is 
Caucasian male veteran of English descent 


servances, with marked conflict about this. He has 
done various types of unskilled labor. He resides 
most frequently with his father. He was seen at a 
VA neuropsychiatric hospital at the time of his 
second admission. 

Description of patient’s appearance. The patient 
is a tall (5 ft. 11 in.), neatly dressed, moderately 
obese, male with a florid facies, who appears tense, 
anxious, and perspires profusely. His face is im- 
mature and boyish. He blushes easily, appears 
earnest, cooperative, friendly, and pleasant, most 
amiable and most eager to please. The patient 
superficially gives the impression of being dull, 
simple, and phlegmatic, but more intensive contacts 
leave the definite impression of at least normal 
which is reduced by a _ pathological 
appears blundering and gross, naive 
sensitive and easily hurt by criticism. 
His affect is blunted but not inappropriate to the 
situation or to the context of conversation. He 
fully oriented and conversation was clear, 
connected, and coherent. No overt psychotic fea- 
tures appeared present at this time although they 
were reported in the history and by the patient. 
There was no obvious memory or intellectual de- 
fect and the patient had “partial insight” into his 
hallucinatory experiences; his present 
‘nt appeared fairly He appeared aware 
socially, econom- 


intelligence 
process. He 


and childlike, 


was 


good. 


of his difficulties in adjusting 


ically, and occupationally outside the hospital. He 
himself openly sought the protection of institu- 
tional life at this time. He recognized his social 


disability and limitations and was able to tolerate 
recent criticisms and joking directed toward him 
from fellow patients much better than he had been 
ble to tolerate such criticism prior to hospitaliza- 


m. He felt much more at ease in the hospital 

han he did outside. He was openly eager for 

1 and ptance with a simple undisguised 

ear of rejection. He appeared to establish with- 

it litticulty a good relationship with the 
cx 

’resenting problem. The patient was first ad- 

itted to the neuropsychiatric hospital in 1945 fol- 

wil s discharge from the service with a 

liagnosis of | hosis with psychopathic person- 

siS in remission manifested by 

pression, c usion, irritability, and 

eli ( flict He le ne hospital 2 mo. later, 

te ving supportive treatment with custodial 

ire and showing some improvement by being less 

‘ 1 le epresse Subsequently he lived 

nely, isolated social and nomadic life with 

I er] ial and economic adjustment, fre- 

I ! 1 often because of his 

Pp W He live in the southeastern por- 

t ( United es for the following year. 

1946 he moved to the northwest to live with 

I er, a preacher. Here he held occasional 

hs and also | very limited social contacts in 

! = ter his discharge from the hospital 

e patient began to gain weight and in the next 


1 approximately 100 Ibs. In 1947, 
wing a VA pension examination, the patient's 


veart caine 
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diagnosis was changed to a schizophrenic reaction, Description of patient’s appearance. The patient 
unclassified type. The patient continued to have is a moderately well- leveloped, thin, fairly well- 
strong differences of opinion with his father who, nourished, adult male of asthenic habitus, 
because of his religious beliefs, objected strenu- who is poorly ned and needs a shave. During 
ously to the patient’s occasional smoking, card he interview he appeared preoccupied and at times 
playing, and occasional drinking and dancing. - t contact with the examiner. He stared off into 
a result of these continuing conflicts, in 1952 . ind appea lost in his own thoughts. He 
patient left his father as he had done frequent a in hi ir with a very tense expres- 
before for similar reasons. He became increas ' sion. His right was clenched into a fist with 
more nervous and hyper-irritable (especially sensi the nails digging deep 


p into the palm. The patient 
tive to loud noises), 1a return of and volur | 


ils and chest pains, lone with gradual pressure. When his 
with substernal pressure symptoms, in additi moved ab hey retained tl ition for 
returned 
looked at 


weak and tire Also, 
past vear the patient had severe 
I slept poorly, had 
return of ideas of 
cinations. He 
whispering ‘on 


il eri 
e material 
ons brietly but 


iments 


considerable 
appearance and excessive weight, 

unemployed status, being foolish, 

eral difficulties in adjustment. Also, 


Lord” ‘ling him hat he was si ul, not a ge | nd requentiy his teeth 


x the inter- 
and nails 


man, and not a good Christian 
aware of | ligious preoccuy 
felt were unl and also 


ng the 
in 
patient 


sycho 


and ideas of r Te ated 1 | 


is 


an mo nal u ar aepress¢ 


contuse 

for his f rdation 
squandered the little monev he 
socially, occupationally, and sexually, and unhappy n the nges in it i He ap- 
m and 


iCLUSIONS 


about his occasional arrests for vagr: 
aware of his increasing difficulties in 
and entered the neuropsychiatric hospit: the upon dire uestionit is preoccupied appear 
second time in 1952 as a voluntary admission in 3 lerment. at plexi wever, led 
order to gain the protection of institutior ; 


tory phe- 
When examined, the hallucinati 


sav at 

hat he 

things 

the 

unin- 

behavior 

1 ng his fist 

€ opinion hie wwain ariou h of the time he 

chiatrist, this case presents the psychiatric features appea 1 However, when 

t irenic reaction, chronic, undifferenti- he ld | nade ract somewhat 
with periodic exacerbations of acute confu h tl 


reference no longer were present and 
had adjusted very well to the 
ward. However, he was fearful of 
disturbing symptoms following 
the hospital and was concerned 
adjustment 


Psychiatric d sts. Int 


ota schiz p 


with ideas of reference and auditory Present } zl atic at he 


cinations. Also there is the development of was in the 


physiologic re- ind neu Stigaty revealed a 


tions accompanying the anxiety and tension states radually increased | ul fi mily 


somatization reactions in the gastro-intestinal ar I t oD \ t and ve his healt! 


cardiovascular systems and genera 


and 
i he 
Test § 12 had incurred an injury (on his head) and was sub- 

Pur- 

Identification. Subject 12 is a 25-vr.-old, single, igation, hh that the 
Caucasian male veteran of Danish descent. He is gement prob- 
Protestant and is religious in attitude, observances, | ince ear ld} 1. The hdrawal, seclu- 
and approach. He is unemployed. He resides wit! , aud poor adjustmen as evidenced in 
his mother and father in their home. He entered a nilitar prior his injury an id only 
VA neuropsychiatric hospital as a voluntary ad ne exaggerated fi \ r the i vy and dis- 


mission patient's 
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allu es which appeared unrelated t 
: tions which he — view he frequently picked at his finger 
hat the voices Frequently he would squirm and twist d a : 
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psychomotor and physical retardation progressed to 
the point of occasional periods of stupor accom- 
panied by auditory hallucination and delusions. In- 
appropriate laughter and impulsive rage unrelated 
to the immediate circumstances had been present 
since 1951. The patient has had psychiatric treat- 
ment at a mental hygiene clinic and also by a 
private psychiatrist. There have been fluctuations 
in his clinical course but there has been gradually 
increasing severity of his psychiatric symptoms in 
the past few years. Although the patient entered 


the hospital voluntarily, he was pressured into the 
hospitalization by his mother who threatened com- 
mitment unless he agreed to coming to the hospital. 

Psychiatric diagnosis. In the opinion of the 
psychiatrist, this case presents the psychiatric fea- 
tures of a schizophrenic reaction primarily cata- 
tonic in type, severe, manifested by auditory and 
visual hallucinations, unsystematized delusions, 
bizarre and obsessive-compulsive behavior, cata- 
tonic withdrawal with psychomotor retardation, 
and other rather typical catatonic features. 
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APPENDIX C 
ITEMS OF TASKS 2-5 


SCALE OF ADJUSTMENT 


Instructions: Indicate where you believe this subject fits on the scale below by putting an “X” at the 
appropriate place on the vertical line. 


ore® 


Making a g ra uate adjustment 


Functioning adequately, but at considerable psy- 


chological cos 
Making a marg ecarious adjustment 


Poor adjustment; should have psychiatric care or 
be in a hospital 


Is a custodial case; cannot survive without care 
® This column was not present on the rating scale. It is presented he to indicate how scores were assi 
divisions of the vertical line. 
Report Type ITems 
Instructions: Items 1-118 are statements (or inferences) about the subject’s personality. On the basis 


of your contact with the subject, answer each item by circling T (True), F (False), or ? (Cannot say) 
on the Answer Sheet. Use ? (Cannot say) as infrequently as possible 


Lack of emotional security is his major Is often hostile without being aware of it 


problem 20. Generall irns to alcohol for release whet 
Rarely expresses any strong emotion he is tense or anxious 

Is in poor contact with reality. 2 ite mature intellectually 

Feels that he is not worthy of the love of 22. She a strong tendency to intellectualization 
others 

Has at least bright normal intelligence 2 ost relations frighten him 

Indulges in counterphobic masculine activity ‘xtremel mnpetitive 

His fear of retaliation blocks any overt ex- 2 feeds affection but in a mature relationship 
pression of his hostility ows relatively few objective signs of 
Possesses much drive and ambition anxiet 

Few things seem to worry him much d H considerable hostility toward 

Is a fast thinker figures 

Feels, unrealistically, that he is under the in 29, Gets along better with men than women 
fluence of others J nerally develops some physical 

He feels, deep down, that he a no good, hen 1 rr anxious 

1ot worth while person 3 lemanding and self-centered 

(This item was inadvertantly omitted from 32 omes depressed very easily 

the judges’ lists.) 33. Is sensitive and introspective 

Considers sex a rather shameful thing 34. Shows no great fear of rejection 

His thinking and ideas tend to be clear-cut 3 i ntellectual approach to problems 
His sexual needs are only moderate ogical and orderly 

Has marked independence strivings Tends to blame his mistakes upon 

Has a great need to be loved k havior is somewhat effen 

Is extremely self-conscious J n ind orderly 
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PSYCHOLOGICAL TEST ANAMNESTIC DATA 39 


Is frustrated by his inability to live up to his “ex pretty mu na par i his peer 
own high standards 
Has little need for affection 
Gets angry usually only when appropriate as marked <¢ lict between his heterosexual 
Is quite hostile towards women 
i his complaints resemble bodily delu 
sions fraid of lis mother 
Sees most of his peer group as competitors 3 marked lepressed | Iverse criticism 
Has episodes of marked emotionality | 
Seems to accept his hostile impulses without Is guilty r hus hostile impulses 
great conflict ( Me! Iperior 1 threatening 
Has considerable fear of getting emotionally Sh mat ‘ igns nxiety 
Is a ver 
ating individual Perceives involving 
nid and inflexible le | 
somewhat overly logical and precise 

His thinking is quite unrealistic 
; himself inferior to others in most 

a number of rather rigidly moralistic 
ittitudes 
Is a mild and self-effacing person resourceful 
Has a definite homosexual conflict own ability 
Is below average in intelligence 
Considers most people he knows as inferior 
to himselt 
Has a reasonable amount of confidence in his 
own ability 
Plans things fairly effectivels 
Seldom feels depressed 
His strong aggressive impulses are a sou Seld 
of marked conflict for him 3. Sees ineffective person 
Has an infantile need for affection Ads 
Is a restless and impatient person 5. Indulges fantasy 
Has a strong desire to rebel against authority Masturl for him 
heures 
Has achieved a comfortable separation from ; 
his parents 


Is a cold and unresponsive person 
Feels adequate to handle most problems he 


meet 
ets 


outlet for hostile 


His thought processes are confused 
Is rather unimaginative 
Has considerable anxiety over un icceptable 
impulses Inter ( nes himself 
Seems unable to concentrate 
Is a friendly and outgoing persor 
strong need for nurturance and p 
hostile impulses are marke inhibited ways tor his behavior 
fear of rejection n interperso mtlict, he tends to blame 
and resourceful person 
tively poor intellectual control 


iosexual trends are not 
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His first 3 years were relatively untraumatic. 
Was raised in foster home or orphanage. 

Was an only child. 

Was youngest child in the family. 

Was oldest child in his family. 

Has had severe blow on the head. 

Had a sheltered childhood. 

Had childhood hobbies. 

As a child had some limiting disease or dis- 
order. 

As a child his family moved often 

As a child was closer to his father than to 
mother. 

His father was a fairly 
person 


stable, unexcitable 
His mother was a fairly stable, unexcitable 
person 

His father was strict 

His mother was strict. 

Was overprotected by his father. 

Was overprotected by his mother. 
Was rejected by his father. 

Was rejected by his mother. 

Had an ineffectual father 

Had an ineffectual mother. 

As a child his home was maternally 
nated 

Relied on his father for guidance 


domi 


Relied on his mother for guidance 

Was given intense corporal punishment by a 
parent 

Felt he did not have the love of one or bot! 
parents 

Had little contact with his father or mother 
His father spent little time with hin 

His father was not regularly in the home 
His father was unemployed for long periods 
His father was alcoholic 


His mother prejudiced him against his father 


As a child felt free to communicate in his 
home 
As a child had enuresis, temper tantrums, 


nail biting, et 

As a child was rejected by his peers 

Had a sibling or friend who was close to him 
As a child had an unfavorable social environ 
ment 
Has been on his own from a fairly early ac 
As a child was hyperactive 

As a child was shy and withdrawn 

Ran away from home 

As a child had dithculties with other childre: 


ot into fights 


Boy 


was member ot 


ool 

y poor marks in school 
Was generally disinterested in school 
Had reading dithiculties in school 
Was truant from school 


Dated girls when |! 


KENNETH B. LITTLE ano EDWIN S. SHNEIDMAN 


FactuaL TRUE-FALSE ITEMS 


17] 


SIN SUSY 


“IO 


Through high school was in relatively 
social activities 

Participated on school teams. 
Skipped grades in school. 

Was given information by 
parents 


few 


sex one of his 

Had early heterosexual play with peer 

Suffered early seduction or early sex trauma 

Had first sexual intercourse before puberty. 

Was the his first 


thonship 


aggressor in sexual rela- 


Had no sexual relations until after he was 21 
Has had 
Has had 
Has suffered from guilt 
Is married 
Has been 1 


Is living with his parents at present 


intercourse with many women 
prostitutes 
ver masturbation 


intercourse witl 


iarried more than once 


Is fairly religious 
Is excessively religious 


Is confused in his religious beliefs 


juite a bit 

rong ethnic prejudices 

Ss quite a bit 

conformist in much of his behavior. 

Is extremely conforming in much of. his 
behavior 
Is an overt homosexual 
Ha 1 homosexual experiences. 
Has anxiety attacks 
Is easily upset or easily tired 


Has nightmares 
Has tears or phobias 
Has obsessive thoughts or compulsions 


Has psychosomatic symptoms. 


Is ve r\ seclusive 
Is very suspicious 
Hallucinates 
Is delusional 
Is depressed 


Has been in trouble with the law 


\s an adult has been in fights or brawls 
\s dult has m 


interests or hobbies 


Has a definitely established 


gainful occupa- 


\ with father or in father’s line of 
we 

Had had several jobs in last few vears 

Had had to stop work because of psycho- 
logical symptoms 

Vas in the Service 

Happiest time of his life was while in the 


Suttere combat 
Was court-martialled while in Service 


Had 


severe stress during Service 


Seve promotions in the Service 
Volunteered for dangerous ssions in. the 
serv 

Suffere ervous breakdown ler Service 
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PSYCHOLOGICAL TEST AND ANAMNESTIC DATA 


Q-Sort Items 


He : a seeks the companions! Ip of 38 He is 


is quite responsive when people show an 
women 


interest in his welfare 
He usually withdraws in social situations 39. He faces unpleasant situations in a direct 
He bvi ly uncomfertable in his contacts manner 
His immediate response when threatened is to 
hght back 
He gets along well with most people 
He responds gratefully to positive gestures 
trom others 
He is quite passive in most of his inter- 
personal contacts 
He adapts easily to social situations 
few friends His friendships seem rather stable and have 
mself when criticized relatively few conflicts 
relating to peopl His relations with mother figures are fairly 
] happy 
He yields meekly to the demands of others 
He responds immediately to any show of ten 
derness or affection 
Rejection from others only makes h more 
ALLTeSsive 
He is tactful and considerate with other people on ~ 
He runs away from hostility in others ‘ : 


He seems to handle criticisn quite well 


Friendly Stures trom others arouse hi 


picion an stility 


He is quite responsive to social stimuli 
He rarely responds to positive 


others 


gestures 


He runs away fr 


seeks social cont; 
ere presen 
hostile ind 
onal contacts ther 1 
well witl 


tt 


ection 


when per ple show 


te 
> 
3 
; 5 
/ 
= Pa 
1] 
it 
13 
14 
15. | 
16. He is rat er td and impersonal in his intet S sus 
actions with women a 
He goes out ot his way to please people a 
is le cepts rather passively mMpositions from 
made upon hit 
19. His social adjustment seems satisfactory 6. om any show of tenderness 
1). He tends to retreat from the stress ar sty or attection 
ot evervday living When others show an interest in him he in a i 
1 He meets the det ands oft Ss environment i hecomes ALEressive nd demandit 
a rather reasonable fashion He has little dithculty in dealing with othe: kee 
»»> CoD! Ba 
He pes into tantasv when threatened people 
3. He tries to n mipulate those round him to He is esponsive to the needs and wishes of ee 
serve his own ends pkey 
24. He is uneasy and uncomfortable around other y He likes to have people show an interest in hit 2 4 
He generally eels accepte by n other 
03 } 
27. He behaves rat er passively in most situations oe b pa vely to anv positive gesture : 
He respor Is we 
ntal der 
i it al 
) He reacts in 
in his interper 
0. He is unable t 
otfered to hin 
31. He retreat ects from others 
i1¢ re when people become ALOTESSIVE Almost ] 
\ Sor al Situation arouses aggressive 2 
mipetes very strongly with father figure 0. He see te meel | 
rie ge along well wit Ss superiors tions with other 
\ mediate ‘ ghtes He shows decreasing involvement in social 
rejection contacts 
He beconx ctl hostil hen } 79 
vely | e when he S He adapts fairly easily. to authority demands : : 
He is only mildly responsive to friendly ap friendly interest in him 
proaches fron therc 
H t. “He is 3 er neutral towards others 
e 1s nerally mnoced P 
ik at posed 1 t ease wit He is rather reserved in most sit mations 
SUTeS Hea epts affection passivel 
: 
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APPENDIX D 


CATEGORIES OF REPORT-TYPE ITEMS 


1. Pressures; forces; press Personality defenses and personality mechan- 
2. Motivations; goals; drives isms 

3. Outlooks; attitudes; beliefs Reality contact; orientation 

4. 

5 


Frustrations; conflicts; fears 3. Interpersonal and object relations 

Affects; feelings; emotions ] Quality of perception, fantasy, language, 
6. Sexual thought and behavior thought 

7. Psychosexual level and development Intellect and abilities 

8. Super-ego; values; ego ideals Symptoms; diagnoses; etiology 

9. Self control; ego strength; ego capacity 7. Prognoses; predictions 

Self concept; insight into self 8. Postdictions 


APPENDIX | 
SIMILARITY RATING SCALE 
INSTRUCTIONS 


On the following pages are a number of pairs of diagnostic statements. Your task is to judge the 
similarity of the two statements within each pair and to indicate your judgment by writing one of the 
six numbers following each pair of statements. In general, your judgment should reflect the extent to 
which you would consider both diagnoses reasonable and acceptable for one patient when made by two 
equally competent diagnosticians from the same thorough examination 


The scale is defined as follows : 


Identical; perhaps minor differences in wording but no question but that the two statements in the 
pair mean the same thing 

Markedly similar; slight variations in minor symptomatology which would ordinarily be considered 
unimportant 

Similar; same general category but definite differences in implied or stated significant characteristics 
Different; diagnoses from different but adjoining broad categories; would require resolution of the 
discrepancies. 

Markedly different; very rarely would one expect to see two such diagnoses on the same person; 
both cannot be accepted 

Utterly different; improbable that two competent diagnosticians could arrive at such opposite 
conclusions 


You will notice that some diagnoses are repeated but are paired with different diagnoses. Occasionally 
even a pair may be repeated. In such cases, you may feel free to refer back to your previous judgment 
Do not linger too long on any one pair; it is your general clinical judgment that is desired. 
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